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Preface 


Functional analysis, partly because of its many applications, has 
become a very popular mathematical discipline. My own lectures on 
the subject have been attended by applied mathematicians, prob- 
abilists, classical and numerical analysts, and even an algebraic 
topologist. This book grew out of my attempts to present the mate- 
rial in a way that was interesting and understandable to people with 
such diverse backgrounds and professional goals. I have aimed at an 
audience of professional mathematicians who want to learn some 
functional analysis, and second-year graduate students who are tak- 
ing a course in the subject. The only background material needed is 
what is usually covered in a one-year graduate level course in 
analysis, and an acquaintance with linear algebra. The book is de- 
signed to enable the reader to get actively involved in the develop- 
ment of the mathematics. This can be done by working the starred 
problems that appear at the end of nearly every section. I often refer 
to these exercises during subsequent discussions and proofs. So- 
lutions to those starred problems appearing in the introductory chap- 
ters (Chapters !—4) can be found in Appendix A. 
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The introductory chapters contain the basic facts from the theory 
of normed spaces. Here the mathematics is developed through the 
discussion of a sequence of gradually more sophisticated questions. 
We begin with the most naive approach of all. In Sections 2 and 3 of 
Chapter |, we study finite dimensional normed spaces and ask which 
of our results are true in the infinite dimensional case. Of course this 
approach does not lead very far, but it does guide us to some useful 
facts. In order to carry our discussion of normed spaces further, we 
take a hint from the history of the subject and learn something about 
integral equations. This is done in Chapter 2, where we also discuss 
the Riesz theory of compact operators. A key result in that theory is 
the theorem associating to each compact operator a pair of com- 
plementary subspaces. At this point we inquire into the connection 
between such pairs of subspaces and continuous projection 
operators and ask if every closed linear subspace of a normed space 
has a complement. The discussion of these questions, which oc- 
cupies some of Chapter 2 and most of Chapter 3, leads us to some 
very deep theorems. It also exhibits the importance of continuous, 
linear functionals. 

Chapter 4 deals with the weak topology of anormed space, and it 
also contains an introduction to the theory of locally convex spaces. 
The latter material is used to prove that a Banach space whose unit 
ball is compact for the weak topology is reflexive. It is used again in 
Chapter 5 and in Chapter 7. 

One advantage of the approach sketched above is that the impor- 
tant theorems stand out as those which must be appealed to again 
and again to answer our questions. It should also be mentioned that 
several of the questions discussed in the text have been the subject 
of a great many research papers. I have made no attempt to give an 
account of all of this work. However, the closely related problems of 
characterizing reflexive Banach spaces and characterizing those 
Banach spaces that are dual spaces are discussed further in Appen- 
dix B. 

The last three chapters of the book are independent of one 
another, and each deals with a special topic. In Chapter 5, John 
Kelley’s elegant proof of the Krien—Milman theorem is presented. 
That theorem is used to settle the question, Is every Banach space 
the dual of some other Banach space? (See Chapter 5 for a more 
precise statement.) Chapter 5 also contains the theorem of Eberlein. 
I have presented Eberlein’s original proof of his famous theorem 
because I feel that it gives insights into this result not found in more 
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modern proofs. It does not yield the most general result known; but, 
I feel, the gain in insight is well worth the slight loss in generality. 
Chapter 6 contains a sample of the interesting, and sometimes sur- 
prising, ways that functional analysis enters into discussions of 
classical analysis. This material can be read immediately after Sec- 
tion | of Chapter 4. Distributions are discussed in the last chapter. 
The Fourier transform is treated early (Section 3) because it requires 
less machinery than some of the other topics. However, Fourier 
transforms are not used in any subsequent section. Applications of 
the theory of distributions to harmonic analysis (Section 3) and to 
partial differential equations (Section Se) are also discussed. 
Readers who are interested only in distributions can read Chapter 7 
immediately. They will however occasionally have to go back to 
Chapter 4 and read some background material. 

I would like to take this opportunity to thank Andrea Blum for 
writing Appendix A. She patiently solved each of these problems 
and proved that they really can be done. I discussed my ideas for a 
book with R. P. Boas of Northwestern University and John S. 
Lomont of the University of Arizona. They each made valuable 
suggestions, and it is my pleasure now to thank them both. I would 
also like to thank Louise Fields for the excellent job she did typing 
the final version of the manuscript. 


Remarks on Notation. The chapters are divided into sections. 
If in a discussion, in say Chapter 4, I want to refer to Theorem | in 
Section 3 of that same chapter, I write ‘Section 3, Theorem 1.”’ If in 
that same discussion I want to refer to Theorem | in Section 3 of 
some other chapter, say Chapter |, then rather than say ‘“Theorem | 
of Section 3 to Chapter I,’’ I simply write *‘Section 1.3, Theorem |.” 


CHAPTER I 


Preliminaries 


Our treatment of functional analysis begins with a long discussion 
of normed vector spaces. The two most important classes of normed 
spaces are the Hilbert spaces and the Banach spaces. Although every 
Hilbert space is a Banach space, the two classes are always treated 
separately. The concept of a Hilbert space has its origin in the papers 
of David Hilbert on the theory of integral equations, and it is well 
known that Hilbert was attracted to this area by the pioneering work 
of I. Fredholm. Hilbert space theory, by which I mean not only the 
study of these spaces but also of the continuous, linear operators on 
them, is one of the most important branches of functional analysis. 
However, to do the subject justice, we would have to double the length 
of this book and so, except for an occasional remark, we shall say no 
more about it. 

Stefan Banach was not the first mathematician to investigate the 
spaces that now bear his name. He did, however, make many impor- 
tant contributions to their study. His book, “ Theory of Linear Opera- 
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tions ” [2], contains much of what was known about these spaces at the 
time of its publication (1932), and some of the deepest results in 
the book are due to Banach himself. The strange title is explained in 
the preface. Banach writes: “ The theory of operations, created by V. 
Volterra, has as its object the study of functions defined on infinite 
dimensional spaces.” He goes on to discuss the importance of this 
theory and some of its applications. Now Volterra is recognized, along 
with Fredholm, as one of the founders of the modern theory of integral 
equations, and it was undoubtedly his work in this area that led him to 
the theory of operations. 

One fact is clear from our epigrammatic sketch of the history of the 
theory of normed spaces, and that is that a large portion of this theory 
has its roots in the study of integral equations. This fact is worth 
keeping in mind. 


1. Norms on a Vector Space 


We shall begin our formal discussion of normed spaces here. In all 
that follows R and C will denote the field of real numbers and the field 
of complex numbers, respectively. We shall always assume that these 
two fields have their standard, metric, topologies, and all of the vector 
spaces that we consider will be defined over one or the other of these 
two fields. Sometimes it is not necessary to specify over which of these 
fields a certain vector space is defined. In that case we shall speak of a 
vector space over K. 


Definition 1. Let E be a vector space over the field K. A nonnega- 
tive, real-valued function p on E is said to be a norm on E if: 


(a) p(x + y) < p(x) + p(y) for all x, and y in E; 
(b) p(ax) = |a|p(x) for all x in E and all « in K; 
(c) p(x) = 0 if, and only if, x = 0. 


If p is anorm on E it is customary to denote, for each x in E, the 
number p(x) by ||x||. A vector space E on which a norm is defined will 
be called a normed space. If we want to emphasize the norm, say ||- 
on E, we shall speak of the normed space (E, ||: ||). 

There is a natural metric associated with (E, ||-||); we define the 
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distance between any two points x and y of E to be ||x — y||. This 
metric gives us a topology on E that we call the norm topology of 
(E, ||-||), or the topology induced on E by ||: ||. Whenever we speak of, 
say, a norm convergent sequence in E, or a convergent sequence in 
(E, ||-||), we mean a sequence of points of E that is convergent for the 
metric topology induced on E by ||: ||. Similarly, we shall speak of norm 
compact subsets of E (or compact subsets of (E, ||-||)), of norm contin- 
uous functions on E, etc. 

The plane (ie., the vector space over R of all ordered pairs of real 
numbers) with ||(x, y)|| defined to be the square root of x? + y? is, 
perhaps, the most familiar example of a normed space. More generally, 
for any fixed, positive integer n, the vector space over K of all ordered 
n-tuples of elements of K (we shall call it K") can be given a norm by 
defining ||(x,, x2, ..., X,)|] to be the square root of }"_, |x,|?. This 
will be called the Euclidean norm on K”. 

It is easy to see that, if there is one norm on a vector space E, then 
there are infinitely many of them; for if ||-|| is a norm on E then so is 
||-||, where, for the fixed positive real number A and each x in E, we 
define ||x||, to be A||x||. There may be other norms on (E, ||- ||) besides 
those that can be obtained from ||-|| in this way. On the vector space 
R?, for example, we have defined ||(x, y)|| to be the square root of 
x* + y?. But we could also define a norm on this space by taking 
II(x, y)l], to be |x| + |y], or by taking ||(x, y)||2 to be the maximum of 
the numbers |x|, |y|. Now in the applications of the theory 
of normed spaces one is often concerned with a family of continuous, 
linear operators on a specific normed space. Here we are using the 
term “linear operator” to mean a linear map from a vector space into 
itself. Clearly the set of all continuous, linear operators on a given 
normed space is determined by the topology on that space and not by 
the particular norm that induces that topology. So it seems reasonable 
to say that two norms on a vector space are equivalent if they induce 
the same topology on the space. This idea is worth further discussion. 

Given a normed space (E, ||-||) and a point x9 in E, the map 
o(x) = x + XQ is clearly onto, one-to-one, and continuous. It also has 
a continuous inverse: @ '(x) = x — X9. So @ is a homeomorphism 
from E with the norm topology onto itself. Since the point xq is arbi- 
trary, this means that the neighborhoods of any point of E are just 
translates of the neighborhoods of zero. Hence we may compare the 
topologies induced on E by two different norms by just comparing the 
systems of neighborhoods of zero in these two topologies. 
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Definition 2. Let (E, ||-||) be a normed space. The set {x in 
E|||x|| < 1} is called the unit ball of E. We shall denote it by 4, or 
By ((l|). 


If r4, is taken to mean {rx|x in 4,}, then any neighborhood of 
zero contains some set in the family {r#, |r in R, r > O}. 


Definition 3. Let E be a vector space over K and let ||-||,, ||-||2 be 
two norms on E. We shall say that ||-||, is weaker than ||-||,, and we 


shall write ||-||; < ||-||2, if there is a positive number 4 such that 
AB (|-l]2) < Bi (|||). We shall say that ||-||, and ||-||, are equivalent, 
and we shall write ||-||, = ||-||2, if we have both ||-||, <||-||, and 
Ili <I lle. 


Suppose that ||-||,, ||- ||, are two norms on E with ||-||, < ||-||2. Let 
A be a positive number such that A#,((|-||2) < Ay (||: |]1). For any non- 
zero vector x in E we have ||Ax||x||z ‘||, < 1. Hence Al|x||, < ||x||2 for 
all nonzero elements of E, and clearly this holds for the zero vector 
also. Thus we can state: Two norms ||: ||, and ||-||, on a vector space E 
are equivalent iff there are positive constants A and yu such that d||x||, < 
\|xl|2 < p||x||, for every x in E. 

The identity map on a vector space E, I, is defined by the equation 
I, x = x for all x in E. This map is, of course, an isomorphism from the 
vector space E onto itself. If ||-||, and ||-||, are two norms on E, then 
the discussion above shows that ||- ||, is weaker than ||-||, iff the map J, 
is continuous from (E 1), and that ||- ||, is equivalent 
to ||-||2 iff J, is a homeomorphism between these two spaces. 


Definition 4. Let (E,, ||-||,) and (E, ||-||2) be two normed spaces 
over the same field. Let T be an isomorphism from E, onto E,. We 
shall say that T is a topological isomorphism if it is a homeomorphism 
from (E,, ||-||,) onto (Ep, ||-|],). 


We note that two norms |-||,, ||- ||, on a vector space E are equiva- 
lent iff the identity map is a topological isomorphism from (E, ||-|| 1) 
onto (E, |}-|2). 
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EXERCISES 1 


A number of useful facts, facts that will be referred to later on in the 


text, are scattered among the exercises. Any problem that is referred to 
later on is marked with a star. The number of starred problems will 
decrease as the material gets more difficult. 


«1. 


#2. 


*4, 


Let (E {x,} be a sequence of points of 
E, and suppose that this sequence converges to a point xX of E for 
the norm topology. Show that lim||x, || = ||xo ||- 


Let E, F be two normed spaces over the same field and let u be a 

linear map from E into F. 

(a) Show that u is continuous on E iff it is continuous at zero. 

(b) Show that u is continuous on E iff there is a constant M such 
that ||u(x)|| <M for all x in the unit ball of E. Hint: If u is 
continuous at zero but no such M exists, then for each posi- 
tive integer n we can find a point x, in E such that ||x, || < 1 
and |ju(x,)|| > m. 

(c) Show that u is continuous on E iff there is a constant M such 
that ||u(x)|| < M||x|] for all x in E. 


We have defined three different norms on the vector space R?. 
Sketch the unit ball of each of these three normed spaces. Show 
that any two of our three norms are equivalent. 


Let E, F be two normed spaces over the same field and let u be a 

topological isomorphism from E onto F. Denote the norm on E 

by ||-||_ and the norm on F by ||-||-. 

(a) For each x in E define |||x|}| to be ||u(x)||;. Show that 
|||-|| | is a norm on E and that it is sie to ||-lle- 

(b) For each y in F define |||y|| | as follows: Let x be the unique 
element of E such that u(x) = y and take |||y|| | to be ||x|],. 
Show that |||-||| is a norm on F and that it is equivalent to 


llr 

(c) Suppose now that E is just a vector space over K, F is a 
normed space over K, and u is an isomorphism from E onto 
F. The function |||-|| | defined on E as in (a) is still a norm 
on E. Show that if E is given this norm then u becomes a 
topological isomorphism from E onto F. If E is a normed 
space and F is just a vector space then similar remarks can 
be made about the function defined on F as in (b). 
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«5. Let E, F be two normed spaces over the same field and let u be a 
topological isomorphism from E onto F. If |-|, and |-|, are 
norms on E and F, respectively, that are equivalent to the original 
norms on these spaces, show that u is a topological isomorphism 
from (E, |-|,) onto (F, |-|,). 


2. Finite Dimensional Normed Spaces 


Before continuing with our general discussion it is instructive to 
investigate the properties of a special class of normed spaces. We have 
in mind spaces (E, ||- ||) for which E is a finite dimensional vector space 
over K. Such spaces do arise in applications. 

Recall that a vector space over K is said to be finite dimensional if, 
for some nonnegative integer n, it has a basis containing n elements; 
the number n is called the dimension of the space. We allow n to be 
nonnegative in order to include the trivial vector space, i.e., the vector 
space over K whose only element is the zero vector. A basis for this 
space is, by convention, the empty set. Hence the trivial vector space 
has dimension zero. It is easy to see that any finite dimensional vector 
space over K can be given a norm. In fact 


Theorem 1. Any two norms on a finite dimensional vector space 
are equivalent. 


Proof. Let F be a finite dimensional vector space over K and let 
||- |, and ||-||, be two norms on F. Choose a basis x,, x2,..., X, for F 
and define a third norm, |-|, as follows: For each x in F there is a 
unique set of scalars a,, #2, ...,@, such that x = }' a,x;. Take |x| to 
be the maximum of the numbers |a,|, |«2|,..., |a,|. Suppose that 
each of the norms ||-||, and ||-||, is equivalent to |-|. Then there are 
positive scalars m,, M, and m,, M, such that 


m, |x| <||x]1<M,|x| and so ma|x| < |x|], <M2|x| 
for each x in F. It follows that 
(m./M,)||x||1 <m,|x| s \|x|2 <M,|x| < (M2/m,)||x||1 


for each x in F, and hence ||-||, and ||-||, are equivalent. 
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Now let ||-|| denote either ||-|], or ||-|/,. We shall show that ||-|| is 
equivalent to |-|. If x = }) a,x, then 
lel =X Loyd ieyll < 11 Meal) 
Since (¥° ||x; ||) is a constant we see that ||-|| is weaker than |-| on F. 
Let S = {x in F| |x| = 1} and choose a sequence {y,} of points of S 
such that lim|ly, || = inf{||x|] |x in S}. For each y, there are scalars a; ,, 
O42) +++» Oy Such that y, = ¥ o,;x;. Since each y, € S, a; | < 1 for 


j=, 2, ..., n and every k. These inequalities imply that there is a 
subsequence of {y,} (call it {y,} also) such that lim «,; exists and equals, 
say, a, forj = 1,2,...,n. Lety = } a,x, and note that {y,} converges to 
y for |-|, ie, lim|y — y,| =0. It follows that |y| = 1 (Exercises 1, 
problem 1) and hence, in particular, y + 0. 

At this point we make an observation. Let A be the maximum of the 
numbers ||x,||, j= 1, 2, ..., n. If a positive number ¢ is given then the 
elements x = ) B,x; and z= ) y;x, of F will satisfy the inequality 
|x — z|| <e, if |B; — y;| <./An for each j, ie., if |x — z| < e/An. This 
fact, together with the remarks contained in the last paragraph, implies 
that lim|]y, || = |ly||- So ||y|| = inf{\]x|] |x in S} and since y #0 this 
infimum is positive. Now if x is any nonzero element of F, then x/|x | 
is in S and hence ||x|| > ||y|| |x|. It follows that |-| is weaker than || - || 
on F. 


Corollary 1. If two finite dimensional normed spaces over K have 
the same dimension, then they are topologically isomorphic. 


Proof. It suffices to show that if a normed space (F, ||-|]) over K 
has (finite) dimension n then it is topologically isomorphic to the space 
K" with the Euclidean norm. There is an isomorphism u from F onto 
K". We can use this map to define a new norm on F as follows: For 
each x in F let |||x|| | be the norm of u(x) in K" (Exercises 1, problem 
4a). When F is given this new norm u becomes a topological isomor- 
phism (Exercises 1, problem 4c). However, Theorem 1 shows that 
| ||-|] | is equivalent to ||-|| on F. Hence u is a topological isomorphism 
from (F, ||-||) onto K" (Exercises 1, problem 5). 


Theorem ! has two other useful corollaries. In order to state them 
we need some more terminology. The proofs of these corollaries will be 
left to the reader (see problem | below). We have already noted that a 
normed space (E, ||: ||) has an associated metric. If E, with this metric, 
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is a complete metric space then we shall say that (E, ||- ||) isa complete 
normed space. More explicitly: 


Definition 1. Let (E, ||-|!) be a normed space and let {x,} be a 
sequence of points of E. We shall say {x,} is a Cauchy sequence if the 
limit, as m and ntend to infinity, of ||x,, — x,, || is zero. We shall say that 
(E, ||-|\) is a complete normed space, or that (E, ||-||) isa Banach space, 
if every Cauchy sequence of points of E converges to a point of E. 


Corollary 2. Any finite dimensional normed space is a Banach 
space. 


If G is a linear subspace of a normed space (E, ||-||), then G can be 
given a norm in a natural way; simply regard each element of G as an 
element of E and take its norm in E. More formally we have an 
inclusion map j from G into E, j(x) = x for each x in G, and we define 
the norm of x € G to be || j(x)||. This is called the subspace norm on G. 
Whenever we work with a linear subspace of a normed space we shall 
always assume, without explicit mention, that it has the subspace 
norm. 


Corollary 3. Any finite dimensional linear subspace of a normed 
space E is a closed subset of E. 


A linear subspace of a normed space E that is also a closed subset of 
E will be called a closed, linear subspace of E. 

We know that any closed, bounded subset of, say, R? is compact. 
This is also true for each of the spaces K”. Is anything like this true for 
normed spaces? This question will lead us to one of the fundamental 
differences between finite dimensional and infinite dimensional 
normed spaces. 


Definition 2. Let (E, ||- ||) be a normed space and let S be a subset 
of E. We shall say that S ts a bounded subset of E if there is a positive 
scalar A such that Sc AA#,. 


It is clear that a normed space has the property that each of its 
closed, bounded subsets is compact iff the unit ball of the space is 
compact. 


Theorem 2. The unit ball of a normed space is compact iff the 
space is finite dimensional. 
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Proof. The sufficiency of our condition follows from Corollary 1. 
Let (F, ||: ||) be a normed space over K and assume that the unit ball of 
this space is compact. If F is not finite dimensional then we can find a 
sequence {x,} of points of F such that any finite subset of {x,} is linearly 
independent. For each positive integer k let F, be the linear subspace of 
F that is generated by x,, x2,..., x,. Note that, by Corollary 3, F, isa 
closed, linear subspace of F,,, , for each k. Suppose that we can choose, 
for each k, a point y, in F,,, such that ||y, || = 1 and |x — y, || >4 for 
all x in F,. Then {y,} is contained in the unit ball of (F, ||- ||) and, since 
lx — Ye+1 || =4 for every k, no subsequence of {y,} is convergent. This 
contradiction shows that F must be finite dimensional. We shall now 
show that we can choose an element y, with the properties stated 
above. 


Lemma. Let E be a normed space over K, let G be a closed, linear 
subspace of E and let 6 be a real number; 0 < 6 < 1. If G4 E, then 
there is a point yo in E such that ||yo || = 1 and ||x — yo || > 6 for all x 
in G. 


Proof. Choose y in E, y not in G, and let d be the positive number 
inf{||y — x|||x in G}. For any fixed point xo in G we may write 


x — (¥ — xo)h¥ — xo lh" = Welly — x0] — Y — xo}$lly - xo ll" 
= [[{@l]y — x0 |] + x0) — y}lly — x0 |)” "I. 


This last term is greater than or equal to d||y — xo ||" ' for every x in G. 
The point yo may be found by first taking x) in G such that 
ly — xo || < dd~', and then setting yp equal to (y — x9)||y — xo || ~!. 


We shall give many examples of normed spaces in the following 
pages. In all of these examples we begin with a family of functions each 
member of which is defined on the same set, say S, and takes its values 
in K or in some fixed vector space over K. Such a family will be called 
a space of functions on S if it isa vector space with respect to the fol- 
lowing operations: For any f, g in the family and any «@ in K, (f + g)(s) 
= f(s) + g(s) for each s in S and af (s) = a[ f(s)] for each s in S. Thus 
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if S is, for example, [0, 1] = {x in R|O < x < 1}, then the family of all 
K-valued, continuous functions on S is a space of functions on S. 


EXERCISES 2 


«1. 


*2, 


«3. 


Prove Corollaries 2 and 3 to Theorem 1. Prove the statement 
made just after Definition 2. Prove that a Cauchy sequence in a 
normed space (E, ||- ||) is a bounded set. 


Let E be a normed space over K. For any subset S of E let cl S 

denote the closure of S. 

(a) If H is a linear subspace of E prove that cl H is a closed, 
linear subspace of E. 

(b) If Bis any bounded subset of E prove that cl B is a bounded 
subset of E. 


Let E, F be two normed spaces over the same field and let u be a 

linear map from E into F. 

(a) Prove that u is continuous on E iff the set u(B) = {u(x)|x in 
B} is bounded in F whenever the set B is bounded in E. 

(b) If E is a finite dimensional normed space show that u is 
continuous. 


Let |,, denote the space of all sequences {x,} of points of K such 
that sup{|x,| |n = 1, 2, ...} is finite. 
x(a) Show that /, is an infinite dimensional space of functions 
on the positive integers. 
x(b) For each x = {x,} € 1, define ||x||,, to be sup{|x,| |n = 1, 
2, ...}. Show that this function is a norm on /,. 
(c) Let F = {x = {x,} in 1, |x, = 0 except for finitely many n}. 
Show that F is a linear subspace of ,,. What is the closure 
of F in 1,,? 
(d) Referring to Corollaries 2 and 3 what can you say about: 
(i) the dimension of F; 
(ii) the vector space F with the subspace norm? 
Let 1, denote the space of all sequences {x,} of points of K such 
that °°, |x, | <0. 
*(a) Show that |, is an infinite dimensional space of functions 
on the positive integers. 
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*(b) For each x = {x,} in 1, define ||x|], tobe ¥@, |x, |. Show 
that this function is a norm on |). 
(c) Let F = {x = {x,} in 1, |x, = 0 except for finitely many n}. 
Show that F is a linear subspace of |,. What is the closure 
of F in 1,? 
(d) Referring to Corollary 2 what can you say about F with the 
subspace norm? 


3. Infinite Dimensional Spaces. 
Hamel and Schauder Bases 


In our treatment of finite dimensional normed spaces we made 
repeated use of the fact that any such space has a basis. Let us take a 
look now at some of the generalizations of this concept. 


Definition 1. Let X be a vector space over K. A subset # of X is 
said to be a Hamel basis for X if it has the two following properties: 


(a) Any finite subset of # is linearly independent. 
(b) Given any x in X there is a finite subset h,, h.,..., h, of # 
such that x, h,, hz, ..., h, is linearly dependent. 


It is an easy application of Zorn’s lemma [15, Theorem 25(e), p. 33] 
to prove that any linearly independent subset of X is contained in a 
Hamel basis for X. In particular, any vector space over K has a Hamel 
basis. Observe that, by (b), every element of X is a linear combination 
of some finite subset of #. Furthermore, if we require that the 
coefficients in such a linéar combination be nonzero, then, by (a), both 
the finite set and the coefficients are uniquely determined by x. So for 
each x in X we can find a unique finite set h,,...,h, in # and a unique 
set of nonzero elements «,, #2, ..-, %, Of K such that x = )7_, a;hy. 
Define ||x |. #|| to be the maximum of the numbers |a,;|,j = 1, 2,...,1 
Clearly ||x|.#|| is the norm for X and we have proved: Any vector 
space over K can be given a norm. 

There is one important space for which a Hamel basis can be 
exhibited. A K-valued function f on [0, 1] is said to be a polynomial 
function if there is a ak ea integer n and elements ag, 4, ..., G, 
of K such that f(x) =)", a,;x/ for all x in [0, 1]. The set of all 
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polynomial functions on [0, 1] is a space of functions on [0, 1] that we 
shall denote by Y[0, 1]. Clearly {1, x, x, ...} is a Hamel basis for 
PO, 1]. 


The set of all K-valued, continuous functions on [0, 1] isa space of 
functions, which we will denote by @[0, 1]. We can define a norm for 
this space as follows: For each fin 6[0, 1] let || f||,, be the maximum of 
the numbers {| f(x)||0 < x < 1}. Observe that a sequence of contin- 
uous functions is convergent for this norm iff it is uniformly convergent 
on [0, 1]. Hence (@[0, 1], ||-||..) is a Banach space. Notice that, in 
contrast to the finite dimensional case, A[0, 1] is a linear subspace of 
€[0, 1] that is dense in this space for the norm topology; this follows 
from the Weierstrass approximation theorem [10, Corollary 7.31, 
p. 96]. We can use the existence of such a subspace to prove that two 
norms on an infinite dimensional space need not be equivalent. 

Let #, be a Hamel basis for Y[0, 1]. We can find a Hamel basis #7 
for 6[0, 1] that contains #,. Choose any point hy that isin # but not 
in #, and define @o(ho) = 1, do(h) = 0 for all h in #, h # ho. Then 
extend @p to all of 6[0, 1] by requiring that it be linear. It is clear that 
#o is a continuous, linear map from (@[0, 1], ||-|.#||) into K because 


Jeol] = Io{ Sash} |< lash) 


<max{|a;||1 <j <n} ¥ |do(h))| < | f ||| 


for each = in 6[0, 1]. If do were continuous on (€[0, 1], ||-||..), then 
{f |bo(f) = 0} would be a closed, linear subspace of (@[0, 1], |: Ilo) 
But this ae i contains [0, 1], which is dense in a0 1], ||: |<): 
Hence if ¢o were continuous on (C[0, 1], ||-||..), it would have to be 
identically zero, contradicting the fact that ¢o(hy) # 0. Observe that 
||| |] and ||-||,, could not be equivalent norms on @[0, 1]. 

We have just seen that a nonzero linear map, from a normed space 
E into the underlying field, whose null space is dense in E must be 
discontinuous. The converse is also true. Before proving it let us give 
these maps a name. 


Definition 2. Let X be a vector space over K. A linear map from X 
into K is called a linear functional on X. The set of all linear func- 
tionals on X will be denoted by X*. 


It is clear that X * is a space of functions on X. We shall call it the 
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algebraic dual space of X or, more simply, the algebraic dual of X. If 
(E, ||- ||) is a normed space over K, then an element ¢ of E* is contin- 
uous on (E, ||-||) iff it is bounded on the unit ball of E (Exercises 1, 
problem 2b). If ¢ is not continuous then {p(x)|x in E, ||x\| < 1} is all of 
K. This is obvious if K = R. The proof, when K = C, is left to the 
reader (see problem 6 below). 


Lemma 1. Let (E, ||-||) be a normed space over K and let d be a 
nonzero element of E*. Then the following conditions on @ are 
equivalent: 


(a) ¢ is continuous on (E, ||- ||). 
(b) The null space of @ is a proper, closed linear subspace of 


(E, ||-|)- 


(c) The null space of ¢ is not dense in (E, ||- ||). 


Proof. We need only show that (c) implies (a). Let N(#) be the 
null space of . If we assume that (c) is true, then there is an open set G 
in E that is nonempty and does not meet N(@). From the discussion in 
Section | there is, for each point x of G, a positive scalar 4 such that 
{x + Ay|y in B,} is disjoint from N(). If @ is not continuous then 
{p(Ay) |» in #,} is all of K. In particular, for some yo in B,, b(Ayo) = 
—(x). But then x+Ayo is in N(p) and we have reached a 
contradiction. 


There is another type of basis that has proved itself useful in the 
study of certain normed spaces. For various reasons, which need not 
concern us at the moment, one usually defines this type of basis only 
for a Banach space. 


Definition 3. Let (B, ||-||) be a Banach space over K. A sequence 
{x,} Of points of B is said to be a Schauder basis for B if for each 
element x in B there is a unique sequence {a,\ of points of K such that 


lim = 0. 


no 


n 
X=) ax, 
j=l 


A Banach space need not have a Schauder basis. If (B, ||-||) is a 
Banach space over R and {x,} is a Schauder basis for B, then the 
countable set {}""_, q;x,|n is a positive integer and q;, 1 <j <n, are 
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arbitrary rational numbers} is dense in (B, ||-||). Similarly, a Banach 
space over C that has a Schauder basis must contain a countable dense 
set. Hence, if a Banach space is to have a Schauder basis, then it must 
have the following property. 


Definition 4. A normed space (E, ||-||) is said to be a separable 
normed space if E has a countable subset that is dense in E for the 
norm topology. 


It is useful to notice that any subset of a separable normed space is 
separable, i.e., if (E, ||-||) is a separable normed space and if S is any 
subset of E, then S contains a countable set whose closure in E includes 
all of S [21, Proposition 13, p. 138]. 

We have seen that only a separable Banach space can have a 
Schauder basis. For many years it was not known whether every separ- 
able Banach space did in fact have such a basis. The question was 
finally settled, in the negative, by Enflo [6]. There is an extensive litera- 
ture on the subject of Schauder bases (see [19] and [22]). However, this 
subject is, we feel, too specialized to be included in this text and, except 
for the results stated in problems 2 and 3 (which we will use in Chapter 
3), we will make no further reference to it. 

The space (I,, ||-||), defined in problem 5 of Exercises 2, will be 
referred to Tater on. Let us show that this is a Banach space. Let 
{v"|n=1, 2, ...} be a Cauchy sequence in this space; here 
vo” = {xf |j = 1, 2, ...} for each n. Then if ¢ > 0 is given there is an 
integer N such that ||v" — v™||, < whenever both m and nare > N, 
ie, 7, |xf — x7'| <e whenever both mand nare > N. Two things 
follow from this: 

(a) For each fixed j the sequence {xj|n = 1, 2, ...} is a Cauchy 
sequence in the field K. 

(b) For each fixed integer k, )¥_, |x} — x7'| < whenever both 
mand nare >N. 

For each j let x; € K be the limit of {x}|n = 1, 2, ...}. We shall show 
that v = {x,|j = 1, 2,...} is in /,. To do this, for any fixed k let v, = (x,, 
XQ, --+y Xz, O, ...) and let vf = (xt, x3, ..., xf, 0, 0, ...) for each n. 
Clearly v, and each vj is in 1,. Hence 


k 
eels < lee — ons + Heels e+ D | xGl 

ps 

Jz 


whenever n > N. If we fix n > N and let k tend to infinity, we find that 
Vz, |x;| <e+ lo", Hence v = {x} is in |). 


3. 
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The only thing left to prove is that lim||v" — v||, = 0. By (b) we see 


that, for any fixed k, )%_, |x? -— x,| <e whenever n> N. Holding 
n > N fixed and letting k tend to infinity gives ||v" — v|| , < ¢ whenever 
n>N. 


EXERCISES 3 


«2. 


«3. 


*4, 


«5, 


Show that (@[0, 1], ||-||..) is a separable Banach space. 
Consider the normed space (I.., ||-||,.) defined in problem 4 of 
Exercises 2. 

(a) Show that this space is complete. Hint: Refer to the proof 
that (1,, ||-|/,) is complete. 

(b) For each fixed, positive integer n let e, be the sequence with 
1 in the nth place and zero everywhere else. Prove that the 
set @,, €>,... 1S not a Hamel basis for |,, and that it is not a 
Schauder basis for I, . 

(c) Let co = {{x,} in 1, |lim x, = 0}. Show that co is a closed, 
linear subspace of (I, ||-|/.) and that e,, e., ... is a 
Schauder basis for co. 

(d) Prove that (I,,, ||-||,.) can not have a Schauder basis. 

Show that the set e,, e2,... (see problem *2b) is not a Hamel basis 

for 1, but that it is a Schauder basis for (1,, ||- |). 

Let X be a vector space over K. A linear subspace Y of X is said 

to have codimension one in X if the following is true: There is an 

Xo in X such that for any x in X we can find y in Y and Ain K, 

both depending on x, for which x = y + Axo. 

(a) Show that a proper, linear subspace of X has codimension 
one iff it is the null space of some nonzero element of X*. 

(b) Let 6, @ be nonzero elements of X*. Show that the null 
space of @ is contained in the null space of ¢ iff there is a 
scalar A such that @ = A. 

Let n bea fixed, positive integer and consider the space K”. If fis 

any linear functional on K” show that there is a unique n-tuple 

(C1, C2, +--+, Cy), €ach c, € K, such that 


Ale] = fll 8) = Devs, 
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for all x = (x,, ..., X,) in K". Hence a linear subspace of codimen- 
sion one in K” coincides with the set of all solutions to an equa- 
tion of the form c, x, + c)X2+ °°: +,X, = 0, where c,, c2,..., 
c, are fixed elements of K not all zero. 

Let (E, ||-|]) be a normed space over C. If ¢ € E* is not contin- 
uous on E, prove that {p(x)|x in E, |x|] < 1} is all of C. Hint: If 
xo € E, ||xo || <1 then ex is also in E, |lexp || = ||xo |, and 


H(e?xo) = e!b(xo). 


CHAPTER 2 


Operator Theory 


From one point of view the study of the finite dimensional normed 
spaces is rather disappointing. Apart from the few, mostly negative, 
results mentioned in Section 1.3, it has taught us little about general 
normed spaces. In fact, since, as we have seen, most of the theorems 
that are true for this class of spaces are true only for this class it is clear 
that we have been exploring a kind of blind alley. So, if our investiga- 
tion of general normed spaces is to proceed any further, we must find 
another way of approaching them. We have already mentioned the 
importance of the work on integral equations for the early develop- 
ment of the theory of normed spaces. Let us take a look at an integral 
equation. 


1. Compact Linear Operators 


Consider the Banach space ([0, 1], ||-||..) and a function K(x, 1) 
that is continuous for 0 <1, x < 1. If an element g(x) @[0, 1] is 
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given, we may ask whether there is an element u(x) of this space such 
that 


(*) u(x) = g(x) + K(x, t)u(t) de. 


Equation («) is a Fredholm equation of the second kind. Such equa- 
tions arise in many applications of mathematics [24]. 

If f(x) € @[0, 1] then the function {§ K(x, t)f(t) dt (call it Kf(x)) is 
also in @[0, 1]. Furthermore, if 


M = max{|K(x, t)||O< t,x <1} 


then |Kf(x)| <M||f'|. for all x, ie, ||Kf||. <M||f||.. Thus the 
map K that takes each f(x) in @[0, 1] to Kf(x) is a continuous, linear 
operator on the Banach space ([0, 1], ||-||...). Let J denote the identity 
operator on our Banach space, and note that the equation (+) has a 
solution in @[0, 1] for a given function g(x) iff g(x) lies in the range of 
I — K. Also, solutions to (*), when they exist, will be unique iff the null 
space of I — K contains only the zero vector. So, to answer questions 
about the existence and uniqueness of solutions to equation (*) we 
should investigate the range and the null space of the operator J — K. 
We shall do that, but first let us examine the operator K more closely. 

Let {h,(x)} be a bounded sequence in ([0, 1], ||-||.); say 
I|hy(x)|| ao <? for all n. Then certainly {Kh,(x)} is a bounded sequence. 
But more is true. We have, for any fixed n, 


|Khybx) — Kh) < [1K Gs 0) — KO )| [Al] at 


< / max{| K(x, t) — K(y, t)| |¢}. 


Now K(x, t) is uniformly continuous. Thus, given ¢ > 0 we can find a 
5 >0 such that | Kh,(x)— Kh,(y)| <¢ whenever |x — y| <6, and 
this is true for every n. It follows that {Kh,(x)} is equicontinuous on 
[0, 1] and so, by the Ascoli-Arzela theorem [21, Theorem 33, p. 179], 
some subsequence of it converges uniformly (ie., for ||-||..). So the 
operator K maps any sequence in @[0, 1] that is bounded for |||]. 
onto one that has a convergent subsequence for ||- ||, . 


Definition 1. Let (B, ||-||) be a Banach space and let K be a contin- 
uous, linear operator on B. We shall say that K is a compact operator 
on B, or simply that K is compact, if for any sequence {x,} of points of 
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B that is bounded for ||- || the sequence {Kx,} has a subsequence that is 
convergent for ||- |. 


It is easy to see that a continuous, linear operator on a Banach 
Space is a compact operator iff it maps any bounded set onto a set 
whose closure is compact. 

We have seen that questions about the existence and uniqueness of 
solutions to certain integral equations lead to questions about the 
range and null space of an operator of the form J — K, where J is the 
identity operator and K is a compact operator on a certain Banach 
space (B, ||- ||). Let these symbols retain this meaning for the rest of this 
section, and let N(J — K) be the null space of I — K. 


Theorem {. The null space of J — K is a finite dimensional sub- 
space of B. 


Proof. The null space of J — K is a closed, linear subspace of B. 
Let @ = {x in N(I — K)]|||x\] < 1}. Since N(I — K) is {yin B| y = Ky}, 
we must have K(#) = &. Thus K(#) isa compact set. But B is the unit 
ball of the Banach space N(J — K) and so this space must be finite 
dimensional (Section 1.2, Theorem 2). 


Applying Theorem | to equation (*), we see that there is a finite 
linearly independent set u,(x), u(x), ..., u,(x) in @[0, 1] that spans 
N(I — K), and if u,(x) is a solution to (*) fora given function g(x), then 
the general solution is 


u(x) = ug(x) + 2, a4,(2); 


1, %,..-, % are arbitrary scalars. 

If y is in the range of J — K, denote this linear subspace of B by 
R(I — K), then there is an x in B such that y = (J — K)x. Even more is 
true. 


Lemma {. There is a number M with the following property: For 
each y in R(I — K) there is an x in B such that y = (I — K)x and 
[xl] < My]. 


Proof. Suppose that the lemma is false. Then for each positive 
integer n there is a point y, in R(J — K) such that whenever x, € B 
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satisfies the equation y, = (I — K)x,, it must also satisfy the inequality 
|x, || > nl\y, ||. Clearly y, #0 because the inequality is strict. For 
n= 1, 2,... choose w, in B such that (I — K)w, = y,. Now no w, Is in 
N(I — K) and this subspace is closed, so each of the numbers 
d, = inf{\|w, — x|| |x in N(J — K)} is positive. Hence for each n we can 
choose v, in N(I — K) such that d, < ||w, — v, || < 2d). 

Define z, to be (w, — v,)|/w, — v, | ' for n = 1, 2, ... Since {z,} is a 
bounded sequence and K is a compact operator we may assume that 
{Kz,| is convergent. Now I ~K applied to ||w, —»v,||z, is just 
(I — K)w,, which is y,. Thus we have ||w, — v, ||||Z, || > n\|y, ||. It fol- 
lows that 


[| — Ken] = [yn fn — enll* < [l2nll/2 = 1/n, 
and solim(/ — K)z, = 0. Since we can write z, = (I — K)z, + Kz,, it is 
clear that lim z, exists. Call this limit z. Then since (J — K)z = 
lim(I — K)z, = 0, z is in N(I — K). But 
IZ, = z| = | |W, = Unll '(w, <2 Un) a Z| 
= [a — (n+ [We — UnllzZ)l [Wa — Onl = dna — Bn]? 2 


This contradicts the fact that lim z, = z. 
Theorem 2. The range of J — K is a closed linear subspace of B. 


Proof. Let {y,} be a sequence of points of R(J — K) that converges 
to y € B. Let M be the number whose existence was proved in Lemma 
1. For each integer n we can choose x, in B such that y, = (I — K)x, 
and ||x, || < M|ly, |]. Since {y,} is a convergent sequence it is bounded 
(Exercises 1.2, problem 1) and so {x,} is bounded. Hence we may 
assume that {Kx,} is convergent. Clearly x, = y, + Kx,, for each n, 
and so {x,} must converge to some point, say x, of B. But then 


(I — K)x = lim(/ — K)x, = lim y, = y 
and so y e R(I — K). 
We will have more to say about the range and null space of I — K 


in the next section. Let us now return to our integral equation and see 
how we might go about solving it. The equation reads 


(2) ue) = abe) + K(x fut de 
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or 
u(x) = g(x) + Ku(x). 
Suppose that g(x) € @[0, 1] is given and construct a sequence in 
€[0, 1] as follows: Take fo(x)=0, f,(x) = g(x) + Kfo(x), fo(x) = 
g(x) + Kf, (x), ....fn(x) = g(x) + Kf, 1(x), -..- If ,(x)} is convergent 
to, say, u(x) for ||-||,., then 
u(x) = lim f,(x) = g(x) + lim Kf,_ ,(x) = g(x) + Ku(x); 

ie., u(x) is a solution to (*). So in order that (*) have a solution it is 
sufficient that the sequence {f,(x)} converge for |\-||.,- 

For any v(x) in @[0, 1] let K°v(x) = v(x), K'v(x) = Ko(x), and, for 
n> 2, let K"v(x) = K[K"~ 'v(x)]. We have 


fo(x) = 0, 
Sil) = g(x) + Kfo(x) = g(x), 
Fr(x) = glx) + Kf, (x) = g(x) + Ka(x), 


Jal) = ols) + Kalx) + K2g(x) +--+ K™ g(x) 


Hence if n > m, then 


Ful) — fn) = K™ g(x) + K™* 'g(x) + + K" 1 g(x). 
Thus a sufficient condition for the sequence {f,} to converge in 
(G[0, 1], ||-|..) is that the series )°_ 9 ||K"g(x)|| be convergent. 


EXERCISES | 


*1. Let (E, ||-||) be a normed space over K and let Y(E) be the space 
of all continuous, linear operators on E. 
(a) For each u in Y(E) show that 


sup{|u(x)||| xl] < 0) 
= sup{|}u(x)h | [x] = 1 
= supi||u(x)|| ||x[|~* |x # 0}. 
(b) For each u in Y(E) define |u|] to be the number 


22 


2. 


2. OPERATOR THEORY 


sup{||u(x)|| | |x|] < 1} (see Exercises 1.1, problem 2b). Prove 
that ||-|| is a norm for Y(E). 


Let (B, ||-|\) be a Banach space, let Y(B) be the space of all 
continuous, linear operators on B, and let # (B) be the set of all 
compact operators on B. 
(a) Prove the statement made just after Definition 1. 
(b) Show that #,(B) is a linear subspace of #(B). 
(c) If Te Y(B) and K e ¥,(B) show that both T © K and 
K o Tare in #(B). 
*(d) If K is in #,(B) and n is any positive integer show that 
there is an operator S, in ¥,(B) such that (I — K)"= 
I —S,. Hint: Use the binomial theorem. 
(e) If T ¢ Y(B) and if the range of T is a finite dimensional 
subspace of B show that Te #,(B). 


Referring to problems 2 and 1b above show that #,(B) is a 
closed, linear subspace of #(B). 


Let K(x, t) be continuous for 0 < t < x < 1, let g(x) € @[0, 1] be 
given and consider the equation 


(++) u(x) = abe) + [KC 1a) de 


This is a Volterra integral equation of the second kind. 

(a) For eachf € 6[0, 1] define Kf (x) to be (§ K(x, t)f(t) dt. Let 
K be the operator on @[0, 1] that takes each f(x) to Kf (x). 
Show that K is a compact operator on (@[0, 1], ||-|]..). 

(b) Show that the equation (**) has a solution in @[0, 1] for any 
given function g(x) € 4[0, 1]. Hint: If 


M = max{|K(x, t)| |O<t<x <1} 
then Yeo Kgl. <e" lige: 


Riesz Theory and Complementary Subspaces 


Here we shall continue with our study of compact operators. 


Throughout this section (B, ||-|]) will denote a Banach space, J the 
identity operator on B and K a compact operator on B. For each 
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n=0, 1, 2,... let N, be the null space of (J — K)"; recall that 
(i—K)=1, (I-K)*=(1—K)(I—K)""! for n>1. Clearly 
O}=NooN, eo Ns ct CN, ON 4 SC. 


Theorem {. For each n the space N,, is finite dimensional. 
Furthermore, there is an integer p such that N, # N,,, for n=0, 1, 
2,....p—1 but N,=N,4, for n= p. 


Proof. We have already proved that N, is finite dimensional (Sec- 
tion 1, Theorem 1). But since (I — K)"=1—S, for some compact 
operator S, (Exercises 1, problem 2d) the finite dimensionality of N, 
also follows from this theorem. 

Suppose that N, # N,4, for n=0, 1, 2,.... For each n choose x, 
in N,,41 such that |\x, || = 1 and inf{||x, — y|||y in N,} > 4. Apply K to 
this sequence. If s > r then 

Kx, = Kx, | = \|x; a4 {( ae K)x, +X, — (I ~ K)x,}|| 2 $. 

But this contradicts the fact that K is a compact operator and we must 
conclude that N, = N,,, for some n. Let p be the first integer for 
which this is so. We shall now show that N, = N,_, forall n> p. If xis 
in N, then (f — K)?*"[(I — K)""?~'x] = (I — K)’x =0. So the ele- 
ment ([—K)’"?"'x is in N,,, But N,,,=N, and so 
(I — K)""'x = (I — K)?[(I — K)"~?~ 'x] = 0. This says that x, an arbi- 
trary element of N,,, is in N,,-, provided n> p. 


Now let R,, be the range of the operator (J — K)" for n = 0, 1, 2, .... 
Clearly B= Rp > R, DR. >°° DR, DR DP '- 


Theorem 2. Each of the spaces R, is a closed, linear subspace of B. 
Furthermore, there is an integer q such that R, #R,+, for n=0, I, 
2,-.-.q—1 but R, =R,4, for n> q. 


Proof. By Section 1, Theorem 2, we know that R, is closed. Since 
(I — K)" = 1 — S, for some compact operator S,, (Exercises 1, problem 
2d), the fact that each R,, is closed also follows from this theorem. 

The argument given in the second paragraph of the proof of 
Theorem 1! can be used here to show that there is some integer n such 
that R, = R,,,. Let q be the first such integer. Since R,,, = R, and 
(f— K)R,=R,+, we have R,..= (J — K)R,4,=(I — K)R,, ie, 
Rg+2 = Rq+1. The fact that R, = R,+, forall n > q can now be proved 
by induction. 
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One might suspect that for a fixed, compact operator K the integers 
p and q are equal. That this ts the case is a corollary of the following 
theorem. 


Theorem 3. Let q be the integer whose existence was proved in 
Theorem 2. Then 


(a) Ny R,= {0}, 

(b) N, +R, ={x+y]x in N,, y in R,} = B, 
(c) K(N,)<N,, 

(d) K(R,) cR,. 


Furthermore, the restriction of the operator J — K to R, has a contin- 
uous linear inverse. 


Proof. (a) We shall actually prove that N,, © R, = {0} for any 
integer m. Suppose that z is in the intersection. For each n > q we must 
have a point z, in B such that z = (I — K)"z, because R, = R, for 
n> q. If we assume that z 4 0 then z, ¢ N,, for every n. But clearly z,, 
does belong to N,,,,, because z belongs to N,,. However, if n is large 
enough, N,,+, = N, and we have reached a contradiction. 

(b) If z € B there is a y in B such that (J — K)*z = (I — K)*4y. 
Hence (I — K)*[z-—(1— K)*y]=0 and we have shown that 
z — (I — K)4y is in N,. But then z, which is equal to[z — (1 — K)4y] + 
(I — K)*y, is in N, + R,, and so the sum of these spaces must be all of 


(c) Note that K(No) c No and (I — K)N, <N,-, <N, far all 
k > 1. Hence 

K(N,) = [I — (I — K)]N, CN, + (I— K)N, CN, + Ny = Ny. 

(d) Note that R,,, = (/ — K)R, = R, and argue as in (c). 

Finally, let J — K|R, denote the restriction of J — K to R,. It is 
clear, by (c), that J — K is a continuous, linear operator on R,. The 
null space of | — K|R, is N, © R, = {0} by (a). Thus J — K|R, is 
one-to-one and hence has a linear inverse. The fact that this inverse is 
continuous follows from Lemma 1.1. 


Corollary 1. The integers p and q defined in Theorems | and 2 are 
equal. 


Proof. Let x be any point of N,,, and find y e N,, z € R, such 
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that x = y + z. Clearly 
(I — K)**'z= (1 — K)**!(x — y)=0. 


But z € R,, | — K|R, has an inverse, and (I — K)R, < R,. It follows 
that z = 0 and hence that x e N,. So N,,, = N, and we must con- 
clude that q > p because p is the first integer for which these spaces 
coincide. Now (J — K)?N, is the zero subspace. Hence 
R, = (I — K)PB 
= (I — K)PR, + (I — K)PN, = (I— KR, =R 


q 


and so p>4q. 


Theorem 3 is very useful for more detailed studies of the properties 
of compact operators [3]. It also leads to some interesting questions 
about Banach spaces. The spaces N, and R, are both closed, their 
intersection contains only the zero vector, and their sum is all of B. 
Given a closed linear subspace G of a Banach space B is it always 
possible to find a closed linear subspace H of B such that G ~ H = {0} 
and G+ H = B? Are such pairs of closed linear subspaces always 
related to continuous, linear operators on B and, if so, what is the 
connection between the operator and the spaces? These questions will 
take us very far in our study of Banach spaces. To begin discussing 
them we need some terminology. 


Definition 1. Let X be a vector space over K. Two linear sub- 
spaces Y, Z of X are said to be supplementary subspaces of X (we also 
say that each is a supplement of the other in X) if their intersection 
contains only the zero vector and their sum Y + Z = {y + z|yin Y,z 
in Z}, is all of X. 

A linear map P from X into itself is said to be a projection operator 
on X if P[Px] = Px for every x in X. 


Given a projection operator P on X the subspaces Y = {x in 
X | Px =0} and Z = {Px|x is in X} are supplementary subspaces of X. 
Note that I — P is also a projection operator on X, that the range of 
this operator is equal to the null space of P, and that the null space of 
this operator is equal to the range of P. Thus if P is a continuous 
projection operator on a Banach space B then both the null space of P 
and the range of P are closed. 
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The even and odd functions illustrate these ideas. Consider the 
Banach space (@[—1, 1], ||-||..). We mean, of course, the space of con- 
tinuous functions on [—1, 1] with |] f|],,. = max{| f(x)|] — 1 <x < I}. 
For any point f in this space define Pf(x) to be 27 '{ f(x) +f(—x)}. 
The operator P that takes f(x) in @[— 1, 1] to Pf (x) is clearly a contin- 
uous projection operator. Hence the range of P, {f | f(—x) =f (x) for 
all x in [—1, 1]}, and the null space of P, { f | f{(—x) = —f(x) for all x 
in {—1, 1]}, are supplementary subspaces of @[—1, 1], and each of 
them ts closed. 


Definition 2._ Let B be a Banach space and let G, H be two sup- 
plementary subspaces of B. If both of these spaces is closed in B, then 
we shall say that they are complementary subspaces of B (we shall also 
say that each is a complement of the other in B). 


EXERCISES 2 


1. Let f be a continuous, linear functional on a Banach space B 
(Section 1.3, Definition 2). Suppose that xo € B and f(xo) = 1. 
Define Tx, for each x in B, to be f(x)xq. 

(a) Show that T is a compact operator on B. 
(b) Identify the spaces N, and R, of Theorems ! and 2. What is 
the integer p in this case? 


2. Let T be a compact operator on a Banach space B. Show that the 
range of T is a separable, linear subspace of B (Section 1.3, 
Definition 4). 


3. Let X be a vector space over K. 
(a) Show that every linear subspace of X has a supplement in X. 
(b) Let Y, Z be two linear subspaces of X. Show that Z is a 
supplement for Y in X iff there is a projection operator on X 
whose range is Y and whose null space is Z. 


4. Give an example of a pair of complementary subspaces in 
(loo lll) and (1, |I-[]1). 

*5. Let B be a Banach space and let G be a closed linear subspace of 

B. Let H be a subspace of B that is a supplement for G in B. It is 

instructive to try to prove that H is closed or that the closure of H 
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is a complement for G. We shall see (Chapter 3) that neither of 
these need be true. 


6. Let X be a vector space over K. We shall say that a linear sub- 
space Y of X has finite codimension in X if the quotient space 
X/Y is finite dimensional. The dimension of the quotient space is 
taken to be the codimension of Y in X. 


(a) 


*(b) 


If Y has codimension n in X show that there is a linearly 
independent set $,, 2, ..., @,in X* such that, if N(@,) is 
the null space of @, for each j, Y = (\j-, N(@;). 

Let ,, $2, ..., b, bea (finite) linearly independent subset 
of X*. Suppose that ¢,¢X* and that N(¢o)> 
(\?-, N(@;). Show that $y, $,, ..., @, is a linearly depen- 
dent set. Hint: Use induction on p. If p = 1 the result is 
already known (Exercise 3, problem 4b). Since @, is a 
linear functional on N(@,), N(¢,) © N(2) has codimen- 
sion two in X. Similarly, if N = (\?-, N(@;), X/N has a 
dimension <p. Since the dimension of X/N is equal to that 
of (X/N)*, these spaces have dimension p. 

Let (E, ||-||) be a normed space and let G be a closed, linear 
subspace of E that has finite codimension in E. Prove that 
G has a complement in E. 


3. The Open-Mapping Theorem 


Given a continuous projection on a Banach space B it is clear (see 
the next to last paragraph in Section 2) that the range and the null 
space of this projection are complementary subspaces of B. Suppose 
now that a pair of complementary subspaces, say G and H, of B are 
given. We may ask whether there exists a continuous projection on B 
whose range is G and whose null space is H. Since G + H = B and 
G © H = {0} we may define P(g + h) to be g for all g in G, hin H. Then 
P is certainly a projection on B, the range of P is G, and the null space 
of P is H. But is P continuous? Let us look more closely at this 


operator. 


We can define a map ¢ from the product space G x H onto B by 
letting ¢[(g, h)] = g +h. This map is linear and one-to-one so ¢7! 
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exists, and it is a linear map. We can also define a map x from G x H 
onto G by letting z[(g, h)] = g. Notice that P=aog"'. 

For each pair (g, h) in G x H let ||(g, h)|| be the maximum of the 
numbers |!g||, ||h||. We leave it to the reader to show that we have 
actually defined a norm on G x H and that, with this norm, G x H isa 
Banach space (problem 1 below). Since ||x[(g, h)]|| = ||g|| < |l(g, h)|| 
and ||@[(g, h)]|| <2||(g, h)||, both of these maps are continuous. But in 
order to prove that P is continuous we have to show that ¢~' is 
continuous. Summing up what we know about @ we are led to the 
following question: Does a linear, one-to-one, continuous map from 
one Banach space onto a second Banach space have a continuous 
inverse? This difficult question will occupy us for the remainder of this 
section. Our first two results are rather technical. 


Lemma {. A normed space (E, ||-||) is a Banach space iff it 
satisfies the following condition: For any sequence {x;} of points of E 
the sequence {}"?_, x;|n = 1,2, ...} converges toa point of E whenever 
the series )'7° , ||x; || is convergent. 


Proof. Assume that (E, ||-||) is a Banach space, let {x;} be a se- 
quence of points of E, and assume that }f°, ||x;|| is convergent. For 
any two positive integers m, n, with m > n, we have 


m n m 
yxu- LYxil} < LY xl. 
i=l i=l i=nt1 


Since this last sum tends to zero as m and n tend to infinity, 
{)7_, x;|n = 1, 2, ...) is a Cauchy sequence in (E, ||- ||). 

Now assume that the normed space (E, ||- ||) satisfies our condition. 
Let {y,} be a Cauchy sequence in this space. We may choose a sub- 
sequence {z,} of {y,} such that ||z, — z,|| < 27‘ for all j >i. Let x, = z, 
and, for i>1, let x,;=z,—2,-,. Clearly }¥.,x,=z, and 
Viet |x|] < lz. | + 1 for all n. It follows that lim }7?_, x; = lim z, 
exists in E. But since {z,} is a subsequence of {y,} and since {y,} is a 
Cauchy sequence, {y,} must converge to a point of E. 


Lemma 2. Let (B,, ||-||,) and (B2, ||-||2) be two Banach spaces 
over the same field and suppose that T is a continuous linear map from 
B, onto B,. If So is {x € B, |||x||, < 1} then for some r> 0 the set 
T(So) = {Tx|x in So} contains {y € B,|||y|]2 <r}. 


Proof. For each n=O, 1, 2,... let S,= {x € B,| |x|, < 27". 
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Since B, = (J? kS, and T is onto we must have B, = (J? , kT(S,). 
By the Baire category theorem [19, Corollary to Theorem 15, p. 139] 
there is an integer k for which the closure of the set kT(S,) (denote this 
by cl[kT(S,)]) has nonempty interior. Thus for some point z’ in B, and 
some positive real number n’, cl[kT(S,)] > {y in B3|||y — 2’. <1}. 
Now the map that takes each y in B, onto ky is a homeomorphism 
from (B3, ||-||,) onto itself. Hence cl[7T(S,)] contains a ball; ie., there is 
a point z in B, and a positive number 7 such that cl[T(S,)] > {y in 
B,|\|y —z||,<1}. Clearly cl[T(S,)] > {y + z||lyll2<1} and so 
cl[T(S,)] — z contains {y in B,|||y|], <7}. But since z is in cl[T(S,)], 


al[7(S,)] - z<el[7(S,)] - elf T(S,)] < 2 7(8,)] 
= el[2T(S,)] = cl[ T(So)]. 


We have shown that cl[T(S,)] contains an open ball, centered at 
zero in B,, having radius n. Clearly cl[T(S,)] will contain an open ball, 
centered at zero in B,, having radius 72°", n= 1, 2,.... 

Now let y be a point of B,, ||)'||, < 727 '. Since y is in the closure of 
T(S,) we can find a point x, in S, such that ||y — Tx, ||, < 12>. Then 
the point y — Tx, is in the closure of the set T(S,), and so there is a 
point x, in S; such that ||(y — Tx,) — Tx. ||, < q2~*. We can continue 
this selection process. After x,, x,,..., X,-, have been chosen we 
choose x, in S, such that 


n-1 
(y- y Tx) - TX, 
i=1 


i= 


eyo en), 
2 
Consider the sequence {x;} of B, that we obtain. We have )'% , ||x; || < 
#2, 2-'= 1 and so, by Lemma 1, the sequence {}""_, x;|n = 1,2, ...} 
converges to a point of B, for ||-||,. Denote the limit of this last 
sequence by }\%, x,, observe that this point is in S,, and that 
T()21 x) = ¥2, T(x;) = y. Hence y is in T(So). It follows that {y in 
B,||y||2 < 12> "} is contained in T(So). 


Remark. It is worthwhile observing that the proof of Lemma 2 
shows the following: The image under a continuous, linear map of one 
Banach space in a second Banach space is either all of the second 
Banach space or it is a set of the first category in the latter space. 


We shall now prove that the question raised in the beginning of this 
section (concerning continuity of the inverse) has an affirmative 
answer. This fact is a special case of the next result. 
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Theorem 1 (Open-Mapping Theorem). Let T be a continuous, 
linear map from one Banach space onto a second Banach space. Then 
T maps any open subset of its domain onto an open subset of its range. 


Proof. Let B,, B, be the domain and the range, respectively, of T. 
These two spaces are, by hypothesis, Banach spaces. If 0 is an open 
subset of B,, if y is a point of 7(6), and if x is a point of @ such that 
Tx = y, then there is an open ball .4, centered at x, such that 4 c 6 for 
6 is an open set. Clearly 4 — x is an open ball centered at zero in By. 
By Lemma 2 the set T(4 — x) contains an open ball 4’, centered at 
zero, in B,. But T(4) — y = T[4 — x] > B’. This says that T(#), and 
hence T(0), contains y + 4’, ie., T(0) is a neighborhood of y. 


Referring again to the discussion given at the beginning of this 
section we have: 


Corollary 1. Let B be a Banach space and let G be a closed, linear 


subspace of B. Then G has a complement in B iff there is a continuous 
projection operator on B whose range is G. 


EXERCISES 3 


«1. Let (E,, |-||,) and (£2, ||-||2) be two normed spaces over the 
same field. For each pair (x,, x2) in E, x E, define ||(x,, x2)||, to 
be the maximum of the numbers ||x, |!, and |}x2 ||2- 

(a) Prove that ||-|, is a norm for E, x E,. This is called the 
product space norm for E, x E,. Whenever we work with a 
product of two normed spaces we shall always assume that 
it has the product space norm. 

(b) Let x, be defined on E, x E, by x,[(x,, x2)] = x). Show 
that 2, is a continuous map from E, x E, onto E,. 

(c) If both (E,, ||-||,) and (E,, ||-||2) are Banach spaces prove 
that (E, x E,, ||-||,) is a Banach space. 


2. Let (E, |!-||) be a normed space and let « be a nonzero scalar. 
Define a map A from E into itself by letting Ax = ax for all x in E. 
Show that A is a homeomorphism from (E, ||-||) onto itself. 


3. For this problem we must recall the Banach spaces 


4. QUOTIENT SPACES OF I, 31 


(L,[0, 1], ||-|],) from real analysis. These spaces are defined in 

Chapter 6. A detailed treatment of them can be found in [10] or 

[21]. Fix p> 1. 

(a) Prove L,[0, 1] < L,[0, 1], but L,[0, 1] # L,[0, 1]. 

(b) Prove that the inclusion map from (L,[0, 1], ||-||,) into 
(L,[0, 1], ||-]],) is continuous. 

(c) Conclude (see the remark after Lemma 2) that L,[0, 1] isa 


4. Let (B, ||-||) be a Banach space and let ||- ||, be a second norm on 
B. Suppose that there is a constant M such that ||x|| < M||x||, for 
all x in B. If (B, ||-||,) is alsoa Banach space prove that the norms 
||: || and ||-||, are equivalent. 


4. Quotient Spaces of |, 


We have gotten away from the question raised in Section 2. Recall 
that we asked whether every closed, linear subspace of a Banach space 
B has a complement in B. The results of this section will be useful in 
settling this question. Here we are going to use the open-mapping 
theorem to prove an interesting representation theorem for separable 
(Section 1.3, Definition 4) Banach spaces. 

Let (B, ||-||) be a separable Banach space and recall the space of 
sequences (1,, || - || ,) defined in Exercises 1.2, problem 5. If {x,} is a fixed, 
countable subset of #4, the unit ball of (B, ||-||), which is dense in %, 
then we can define a linear map T from I, into as follows: For any 
point {t;} of I, let T[{t;}] = YF, t,x,. Since 


I7Ls]l| < x Is| xl s y lol = Meath 


T is a continuous linear map from (1,, on ) into (B, ||-|/). Let us show 
that T is onto. 

For any "agi ; in & choose x,, in {x,} such that ||x — x,, | <4. 
The set {5x,|j # n,} is dense in 44, and so there is a point x,, in {x} 
such that ||(x — x, oe 4x, || < 2” 7. We can even assume that Ny > ny. 
Continue selecting points in this way. After x, Xp)» +++» Xn, have been 
chosen, choose x,,,, satisfying |x — }¢} 27'*'x,,|| <2°*"' and 
with n,,, >n,. Define {t,} € 1, as follows: 1, = 0 ifn #n, for all k; 
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t, = 27**! ifn =n,. Clearly T[{t,}] = x and so Z is contained in the 
range of T. 

Let G be the null space of T. Then, of course, G c I, and the linear 
map T induces an isomorphism from |, /G onto B. Call this isomor- 
phism T*. If 1, /G has a norm, say ||-||,, if (1, /G, ||-||,) is a Banach 
space, and if T* is continuous from (I, /G, ||-||,) onto (B, ||- ||), then by 
the open-mapping theorem T* is a topological isomorphism. In other 
words, if we can define a norm ||-||, on /, /G with the properties just 
stated, then we shall have proved: 


Theorem 1. Every separable Banach space is topologically iso- 
morphic to some quotient space of (1, || -||1). 


Let (E, ||-||) be a normed space and let G be a linear subspace of E. 
For each x in E let x denote the element of E/G that contains x. Define 
a function ||-||, on E/G as follows: ||x||, = inf{||x + g|| |g in G} for each 
x in E/G. This is clearly a nonnegative function on E/G, and it is easy to 
see that |X + ily < [ile + [ile amd act|g= |a|||xjp for all x, y in 
E/G and all « in K. 


Lemma 1. The function ||: ||, isa norm for E/G iff G is closed. 


Proof. Suppose that G is a closed, linear subspace of E. Let x be 
an element of E/G such that ||x||, = 0, and let x bea fixed element of x. 
For any positive integer n there is a point g, in G such that ||x + g, || < 
1/n. But then the sequence { ~ g,} of points of G converges to x. Since G 
is closed it follows that x € G and so x = 0. 

Now assume that G is not closed and let x be a point that is not in 
G but is in the closure of G. If {g,} is a sequence of points of G that 
converges to x then ||x||, < inf{\|x — g,|||n= 1, 2,...}. Since the 
infimum is zero, ||x||, = 0. But x # Oand so ||-!|, could not be a norm 
on E/G. 


Definition 1. Let (E, || - ||) be a normed space and let G be a closed, 
linear subspace of E. The norm on E/G defined just before the state- 
ment of Lemma | is called the quotient norm on E/G. 


Whenever we work with the quotient space of a normed space and 
one of its closed, linear subspaces, we shall always assume, without 
explicit mention, that it has the quotient space norm. We shall also 
omit the subscript q on the quotient norm. 
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Theorem 2. Let (B, ||-||) be a Banach space and let G be a closed, 
linear subspace of B. Then B/G is a Banach space. 


Proof. Let {x,} be a Cauchy sequence in B/G. Then there is a 
subsequence {x,,} of {x,} such that ||x,, — x,,, || <_27* for all m > k; in 
particular ||x,,,, — x, || < 27* for every k. It follows, from Definition 
1, that there are elements x,, Of X,,, X,, Of X,,,... such that 
llXnes1 — Xm | < 27* for all k. Now if 1 > k then 

[ny ~ Xn | s [Xn P= Xa ls sem ~ Xn 
< Q-ttl pee Qh Deed. 


Hence {x,,} is a Cauchy sequence in the Banach space (B, ||: ||). Let 
x € B be the limit of this sequence. Since ||x,, — x|| < |lx, — xl, {Xn 
converges to x for the norm of B/G. But then {x,} must converge to x 
for this norm. 


EXERCISES 4 


1. Let (E, ||:||) be a normed space and let G be a closed linear 
subspace of E. For each x in E let N(x) be the unique element of 
E/G that contains x. Let N be the map that takes each x in E to 
N(x) € E/G. Show that N is continuous. 


2. Let (E, ||-||) be a normed space and let (B, ||{-|||) be a Banach 
space. Suppose that T is a continuous, linear map from E onto B 
with null space G. We may define a map T* from E/G onto Bas 
follows: For each x in E/G choose x in x arbitrarily, and let 
T*x = Tx. 

(a) Show that T* is a continuous, linear map from E/G onto 
(B, |{|-||). 

(b) If ie) i} happens to be a Banach space show that T* isa 
topological isomorphism. 


«3. Let (B, 


‘|[) be a Banach space and let G be a closed, linear 
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subspace of B. Show that any two complements of G in B are 
topologically isomorphic. 


5. The Closed Graph Theorem 


The closed graph theorem is a particularly useful relative of the 
open-mapping theorem. 


Definition 1. Let T be a linear map from the normed space 
(E,, ||-|\,) into the normed space (E, || -||2). The set {(x, Tx)|x in E,}, 
which we shall denote by 4(T), is called the graph of T. 


We leave it to the reader to show that Y(T) is a linear subspace of 
E, x E, and that, if T is continuous, Y(T) is closed in the product 
space. The remarkable fact is that, for Banach spaces, the converse is 
true. 


Theorem 1 (Closed Graph Theorem). A linear map from one 
Banach space into a second Banach space is continuous iff its graph is 
closed in the product of the two spaces. 


Proof. Let T be a linear map from the Banach space (B,, |: |\;) 
into the Banach space (Bp, ||: ||2). If G(T) is closed in B, x B, then, 
since B, x B, is a Banach space (Exercises 3, problem Ic), G(T), with 
the subspace norm, is itself a Banach space. For each (x, y)in B, x B, 
let p(x, y) = x, q(x, y) = y, and let x be the restriction of p to G(T). By 
the open-mapping theorem x~' is a continuous, linear map from 
(B,, || ||1) onto Y(T). Hence the continuity of the map T follows from 
the equation T=qon'. 


Corollary 1. Let (B, ||: ||) be a Banach space and let G, H be two 
closed, linear subspaces of B such that G m H = {0}. Then G+ H ts 
closed iff there is a constant a such that ||x|| <a||x + y|| for all x in G 
and all y in H. 


Proof. Assume that G + H is closed in (B, ||- ||) and define a linear 
map T from G+ H onto G by setting T(x + y) =x for all x + y in 
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G + H. We shall show that 4(T) is a closed subset of (G + H) x G. Let 
{(w,, Tw,)} be a sequence in 4(T) that converges to some point of this 
product space. Then {w,} and {Tw,} must both converge. Writing 
Wa = Xn +Y,, Where x, € Gand y, € H for all n, we see that {w,} and 
{x,} must both converge. It follows that {y,} is convergent. Since G, H, 
and G + H are closed, these sequences converge to points wo, Xo, Yo In 
G+ H, G, and H, respectively. But wo is clearly x9 + yo and so 
TWo = Xo, te., G(T) ts a closed set. By Theorem 1, T is continuous and 
hence ||x|| < || T|||\x + y|| for all x in G, y in H (Exercises 1.1, problem 
2b and Exercises 2.1, problem 1b). 

The proof that our condition is sufficient to insure that G + H 1s 
closed is left to the reader. 


The following example shows that the open-mapping theorem need 
not be true for normed spaces that are not Banach spaces. Consider 
(6[0, 1], ||: ||) and let F be the linear subspace of @[0, 1] consisting of 
all functions f such that f’ exists on (0, 1) and is uniformly continuous 
on that interval. If fe F then there is one and only one function that is 
continuous on [0, 1] and is equal to f’ on (0, 1). Denote this function 
by f' also. Thus, defining Tf =f’ for all fe F, we have a linear map 
from the normed space F into the Banach space @[0, 1]. Since 
F + @[0, 1] but F does contain every polynomial function, F can not 
be a Banach space. The set {x"|n = 1, 2, 3, ...} is bounded (Section 1.2, 
Definition 2) in F, However, {Tx"|n = 1, 2,...} = {nx"™"|n = 1, 2,...} 
is not bounded in (@[0, 1], ||: ||..). It follows (Exercises 1.2, problem 3a) 
that T can not be continuous. But it is easy to see that the graph of T is 
closed. 


EXERCISES 5 


1. Let (E,, |: ||1), (Es, ||: lz) be two normed spaces, let T be a linear 
map from E, into E,, and let G(T) be the graph of T. 
(a) Show that Y(T) is a linear subspace of E, x E}. 
(b) If T is continuous prove that Y(T) is closed in E, x E}. 

2. Referring to Corollary 1 prove that the condition stated is 
sufficient to insure that G + H is closed in B. 

3. Let T be a linear, one-to-one, continuous map from the Banach 
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space (B,, ||-||,) onto the Banach space (B,, ||-||,). Use the closed 
graph theorem to prove that T has a continuous inverse. Hint: 
The map (x, y)>(y, x) is an isomorphism from 9(T) onto 
G(T~'). 

Show that the discontinuous, linear map defined at the end of this 
section has a closed graph. 


CHAPTER 3 


Linear Functionals 


1. Special Subspaces of /,, and 1,. 
The Dual Space 


We have been talking about complementary subspaces of a Banach 
space for some time now. We know about their connection with con- 
tinuous, projection operators and we have seen some examples. But 
the fact is that a closed, linear subspace of a Banach space may not 
have a complement. Here are some examples: 


(a) The Banach space (I,,, ||- ||) consists of all bounded sequences 
{x,} with ||{x,}|] = sup{|x,|]n= 1, 2, ...}. For each fixed, positive 
integer k let f,(x) =f,({x,}) = x, for all x in 1. So f, maps each 
bounded sequence onto its kth term. Clearly each f, is a continuous, 
linear functional on (I,,, |{-{|,,) (Section 1.3, Definition 2) and if, for x 
in 1,,, f(x) = 0 for all k, then x = 0. 
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The sequences that converge to zero comprise a closed, linear sub- 
space (we called it co (Exercises 1.3, problem 2)) of /,,. If cg had a 
complement H in |, then there would be a topological isomorphism @ 
from I,,/c) onto H (Exercises 2.4, problem 3). For each k, let 
h,=f,° ~. Then {h,} is a countable set of continuous, linear func- 
tionals on |,, /co that has the following property: 


(*) If x is in 1,,/cg and if h,(x) = 0 for all k, then x = 0. 


We shall show that cy does not have a complement in /,, by showing 
that no countable set of continuous, linear functionals on 1,, /cg can 
have property (+). 

Let Z, denote the set of all positive integers. We can regard I,, as 
the space of all bounded functions on Z, . If U is a subset of Z, then 
the function that is one at each point of U and ts zero at each point that 
is not in U is called the characteristic function of U. Any such function 
is in /,,. We must now prove some facts about Z, and about 1,, /co. 


(i) There is an uncountable family {U,|a in A} of subsets of Z., 
such that each U, is an infinite set, and U, 7 U, is finite for a # b. 


Let be a one-to-one correspondence from the rationals in (0, 1) 
onto Z, and let A be the set of all irrationals in (0, 1). For each ain A 
let U’, be the terms of any sequence of rationals in (0, 1) that converges 
to a. Setting U, = w(U;) for each a in A we obtain a family of sets with 
the required properties. 


(ii) For each ain A let x, be the element of I,, /co that contains the 
characteristic function of the set U, (we mean, of course, the family 
described in (i)). Let g be any continuous, linear functional on I,, /co. 
Then {x,| g(x.) # 0} is countable. 


We need only show that, for each n in Z, , {x,||g(x,)| = 1/n} is 
finite. Choose and fix nand let x,,..., x,, be in the set under discussion. 
Let b, = g(x;)| g(x;) | | for j = 1, 2,..., n (the bar denotes the complex 
conjugate) and let x = )"", b,x,. Clearly x € 1, /co, the norm of x is 
less than or equal to one, and g(x) > m/n. Since g is continuous, m must 
be finite. 

If {hj} is any countable set of continuous, linear functionals on 
1,,/co, then there are only countably many x, such that h,(x,) # 0 for 
j = 1, 2,.... Since A is uncountable this implies that for some x, # 0 
every h,(x,) = 0. Thus co is a closed, linear subspace of (I,,, ||: ||.) that 
has no complement in /,,. 
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The first person to prove that cg does not have a complement in I, 
seems to have been Sobezyk [23]. He observed that this is an easy 
consequence of a result of Phillips [20]. The elegant proof given above 
is due to Whitely [25]. 


(b) In order to present our next example we shall need some 
preliminary results. These are interesting in their own right. If {y,} is in 
1, and {x,} is any sequence such that )° |x,| < oo, then 


[de xndnl SDE [Xnvel SMV llo Le [Xnl- 


Hence ¥° x, ),, is convergent and we have shown, moreover, that every 

element of /,, defines a continuous, linear functional on (1, | -|{I;) 
The sequence e,, e,,..., &,,..., where e, = (0,0, ...,0, 1,0, 0,...) 

(the 1 is in the kth place) is a Schauder basis for (1, ||: | ,) (Exercises 1.3, 


problem 3). For any continuous, linear functional f on (J;, ||-||,) the 
sequence { f(e,)} is in 1,,. If x isin J, then lim||x — )%-, a;e; ||, = 0 for 
some unique sequence of constants a,, az, .... Clearly f(x) = 


¥. a;f (e;), ie., the continuous linear functional f is defined by the ele- 
ment { f(e,)} of I... Thus the space of all continuous, linear functionals 
on (I,, ||:||,) is isomorphic to the vector space I, 


Lemma 1. A sequence {x,} of points of J, is norm convergent to 
zero iff lim f(x,) = 0 for any continuous, linear functional f on 1,. 


The proof is rather tricky and so we shall try to give the idea behind 
it first. Suppose that {x,,! is a sequence in |,. Each x, is itself a sequence, 
say x, = {t,(n)|i = 1, 2,...}. Assume that lim f(x,) = 0 for each contin- 
uous linear functional f on 1,. Then, since e;,e,,... are in 1,,, each t,(n) 
converges to zero as n tends to infinity, ie., lim, t(n) = 0 fori = 1, 


2, .... If v= {v} is in 1, then v(x,) = ¥%2, v,t,(n) and clearly 
lim, Uj: t(n) = 0 for i= 1, 2, .... Now write 
n-1 roa) 
aa > v,t,(n) + Unt, (n) + Y v;t,(n). 
i=1 i=nt+1 


Suppose, on the assumption that {x,} does not tend to zero for the I, 


norm, that we can find ¢ > 0 and v = {v;} in 1,, with |v;| = 1 for alli 
such that |}? } v,t,(n)| <e/5, |v,t,(n)| > 3e/5, and 
Yu, t(n)| < 6/5 
i=n+1 


for each n. When n= 1 we have |v,1,(1)| > 3e/5, ie., we have a 
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“hump” in the first term. We know the hump cannot stay there be- 
cause v,f,(n) tends to zero as n increases. But when n= 2, 
| v2 t2(2)| > 3e/5, so our hump now appears in the second term. It 
moved. When n= 3 the hump is in the third term, and so on. As n 
increases the hump “ glides ” toward infinity. Now clearly, if we can do 
this, 


|r(x,) | 


> |e,t,(n)| — | ¥ v;t,(n) 


i=1 


be a) 


en) 


i=n+1 


& 
¥ v,t,(n) — > 2/5, 
so lim v(x,) is not zero and we have our contradiction. The proof 
below is a refinement of this idea. 


Proof of Lemma 1. The necessity of our condition is clear. Assume 
that {x,} satisfies this condition and, for each n, let x, = {t,(n)|i = 1, 2, 
3, ...). If this sequence does not converge to zero for the norm of 1,, 
then there is an « > O and infinitely many integers n,,j = 1,2,...,such 
that ||xq, ||, = 2721 |t(nj)| > & Choose N, so large that 

fo 


Nt 

> |e(n,)| <e/5 and Y | ti(n)| > 46/5. 

Ny+1 i=1 

Next choose complex numbers v,, v2, ..., Uy, Of modulus One so that 
Ny 


Ny 

DLeitdm) = 2M) > 4e/5. 
Observe that, if v; is any complex number of modulus one when 
i> N,, |¥ v;t;(ny)| > 3/5 > ¢/S. Now take/, so large that n,, is large 
enough to imply that )'}' |1,(n;,)| <¢/5; this is possible because of 
our assumption on {x,! and the fact that the sequences e,,e,,... are in 
L,. Now take N, > N, so that 


ro N2 
> lenj,)| <e/5 and dl t:(n;,)| > 46/5. 
N2+1 1 


We can choose complex numbers ry ,4 1. Uy, 425+-+» Uy, Of modulus one 
so that 


N2 


Y v,t(n;,) = ¥ | t(nj,)| > 3/5. 


Ny+1 


Again if vu, is any complex number of modulus one for k other than 
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N,+1,..., N2 then 


N2 Ni oo 
|X vtdnj,)| 2] 2 |-{L}-]| 2d > 4. 
Ni+1 1 N2+1 
This process can be repeated and, using induction, we can obtain a 
sequence {v,;} such that |v;| = 1 for all i, and so {v,}e1,, and 


|° v,t,(n;,)| > 6/5 for k = 1, 2, .... This is a contradiction. 


If (B, ||-||) is a separable Banach space, there is a closed linear 
subspace G of (I, ||-||,) such that (B, ||-||) and J, /G are topologically 
isomorphic (Section 2.4, Theorem 1). Suppose that G has a comple- 
ment, say H, in |,. Let ¥ be the family of all continuous, linear func- 
tionals on H that are restrictions to H of continuous, linear functionals 
on /,. Then, by Lemma 1, a sequence {x,' of points of H converges to 
zero iff lim f(x,) = 0 for every f € ¥. It follows that there is a family, 
say Y, of continuous, linear functionals on (B, ||: ||) such that {y,} < B 
converges to zero iff lim g(y,,) = 0 for every g € Y. Hence, to prove that 
there is a closed, linear subspace of |, that does not have a complement 
it suffices to show that there is a separable Banach space (B, ||- ||) and a 
sequence {y,} of points of B such that lim g(y,) = 0 for every contin- 
uous, linear functional on (B, ||: ||), and yet {y,} is not convergent to 
zero. We shall show that the separable Banach space (co, ||: ||...) has a 
sequence with these properties. 

If {y,} €1, and {x,} is any element of co, then |¥ x,y,| < 
[|{xn}l <o {l{Hntl|1. and so every element of J, defines a continuous, linear 
functional on co. We have seen that e,, e2,... is a Schauder basis for co 
(Exercises 1.3, problem 2). Let f be a continuous, linear functional on 
(cos || l)o) let M(S) = sup{| f(x)| |x € co, |xi].. < 1} and consider the 
sequence { f(e,)}. For {xq} € Co, f({xn}) = ¥ x, f(e,)- Letting sgn a = 
a/|a| for a : 0, sgn(0) = 0, it is clear that u, = (sgn f(e,), sgn f(e2), 

‘i ens e,), 9, 1 my is in co and has norm one. But for any k, 


= >i | fle, M(f). Hence {f(e,)} is in I, and the space of 
oa ne ee ON Cp is isomorphic to |). 
Now, co is certainly separable, and |e, |) = 1 for all n, yet 


lim f(e,) = 0 for every continuous, linear functional f on cg. 


Our work so far has clearly shown that the continuous, linear 
functionals on a normed space can be very useful in studying that 
space. In each of our examples there were always many obvious con- 
tinuous, linear functionals on the given spaces. If, however, one con- 
siders a general normed space, then it is not clear, at this stage of our 
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discussion, that there are any continuous, linear functionals on the 
space except the trivial one, ie., the map that takes each point to zero. 
Let us ignore this difficulty for the moment. 


Definition 1. Let (E, ||: ||) be a normed space. The vector space of 
all continuous, linear functionals on (E, ||: ||) will be called the dual 
space of (E, ||: ||) or, simply, the dual of E, and it will be denoted by E’. 


If fis a continuous, linear functional on the normed space (E, |||), 
then the number sup{| f(x)| |x in E, |x|] < 1} will be denoted by | f||. 
It is easy to see that the function that takes each fin E’ to || f|| isa norm 
for E’. Whenever we speak of a norm on the dual of a normed space we 
shall always mean the norm defined in this way. This is sometimes 
called the dual space norm. Clearly, for any fin E’, | f(x)| < [fl |lx| 
for all x in E. 


Theorem 1. The dual ofa normed space is always a Banach space. 


Proof. Let (E, |\:||) be a normed space and let {f,} be a Cauchy 
sequence in the normed space E’. Then given ¢ > 0 we can choose an 
integer N such that || f, — f,,|| <¢ whenever m > N and n> N. For 
any x in E we have | f,(x) — fn(x)| < || fn — Sn |) |x[] and so {f,(x)} is a 
Cauchy sequence in the field K. Hence, for each x in E, we can let 
f(x) = lim f,(x). Clearly, f is a linear functional on E and | f(x) — 
Sm(X)| < e||x|| for all x, whenever m > N. Let M = sup{|l f, || |n = 1, 2, 
...} (Exercises 1.2, problem 1). Then 


|.£(x)| < |F 0) ~ fax) | + | fnl<)| < (6 + M)Ix| 


for all x in E, and so fe E’. 
Finally, 


|f— Sm] = sup{| f(&) ~ fal) | | [xl] < 1} <e 
for m > N. This says that { f,} converges to f for the dual space norm. 
It is sometimes possible to identify the dual of a given normed 


space (see problem 1 below). When we say that two normed spaces can 
be identified we mean that they are equivalent in the following sense: 


Definition 2. Let (E, ||-||) and (F, |||-|| |) be two normed spaces 
over the same field. An isomorphism @ from E onto F is said to be an 


1. 


SPECIAL SUBSPACES OF |, AND |, 43 


equivalence if | {{@(x)||| = ||x|| for all x in E. We shall say that two 
normed spaces are equivalent if there is an equivalence from one of 
these spaces onto the other. 


EXERCISES 1 


«5, 


a) Show that the dual of (1,, ||-||,) is equivalent to (/,,, ||+|{..). 
(b) Show that the dual of (co, ||'||,.) is equivalent to (1,, ||-|{,). 
(a) What can you say about any projection operator on (I,,, 
||: ll.) Whose range is co? 
) What can you say about any supplement for co in 1,,? 
(c) Let H be a subspace of I, that is a supplement for cp in I,,. 
What can you say about cl H A co? 


(a) Prove the “necessity” part of Lemma 1. 

(b) Show that the analog of Lemma | is true for any Banach 
space that is topologically isomorphic to (1, |{- {|;). 

(c) Show that, if H is any linear subspace of (J, ||: ||), a se- 
quence of points of H, {x,}, converges to zero for the norm of 
H iff lim f(x,) = 0 for every continuous, linear functional on 


(a) Referring to the paragraph just after Definition 1, show that 
the function defined there is a norm for E’. 
(b) Iffis any element of E’ prove that 


If ll = supt] F(x) | [xl] " |x in E, x # 0} 
= supt | f(x)| |x in E, [|x| = 1}. 
Let (E, ||: ||) and (F, |||: || |) be two normed spaces and let (E, F) 
be the space of all continuous, linear maps from E into F. If 
T € S(E, F) let || T||, = sup | || T(x)|| | |x in E, ||x|] < 1} (see Exer- 


cises 1.2, problem 3a). 
(a) Show that ||-||, is a norm for P(E, F). 


(b) If (F, |||-}||) is a Banach space then show that ((E, F), 
|||) is also a Banach space. Hint: Modify the proof of 
Theorem 1. 


Let E be a vector space over K. A map @ from E x E into K is 
called an inner product on E if: 
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(i) (ax + by, z) = ad(x, z) + b(y, z) for all x, y, z in Eand 
all scalars a, b; 
(ii) (x, y) = O(y, x) for all x, y in E; 
(iit) (x, x) > 0 for all x in E with equality iff x =0. It is 
customary to denote (x, y) by <x, y>. 


(a) Let E bea vector space and let <,> be an inner product on 
E. Show that the function that takes x in E to the square 
root of <x, x> is a norm on E. This is the norm induced by 
the inner product. 

(b) Let n be a positive integer and consider the vector space C”. 
For x = (x;, ..., x,) and y = (y;, ..., y,) in this space let 
<x, y> = 1 x, ¥,- Show that ¢, > is an inner product on C”. 

(c) Show that the norm induced on C” by the inner product 
defined in (b) is the Euclidian norm on C". Thus C” is com- 
plete for this norm. If H is a vector space over K, ¢,> is an 
inner product on H and H is complete for the norm induced 
by this inner product, then we say that (H, <, >) is a Hilbert 
space. We shall not say very much about these spaces (but 
see Chapter 6). However, we must mention the following 
remarkable result: A Banch space is a Hilbert space iff each 
of its closed, linear subspaces has a complement [18]. 


2. The Hahn-Banach Theorem 


Our long discussion of complementary subspaces began with the 
observation that such a pair of subspaces is associated with every 
compact operator (Section 2.2, Theorem 3). This led us to ask whether 
every closed, linear subspace of a Banach space has a complement. We 
answered that question in the last section. Let us go back now and 
recall that when we associated a pair of complementary subspaces with 
a compact operator one member of the pair was finite dimensional. So 
we may ask: Does every finite dimensional subspace of a Banach space 
have a complement? The answer is “yes,” as we shall now show. 
Incidentally, the reader may wonder why we did not ask this more 
modest question right at the start (i.e., right after we proved Theorem 3 
of Section 2.2). We could have, but the general question would have 
arisen sooner or later anyway. 
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Suppose that (E, || - ||) isa normed space (there is no need to assume 
completeness, as we shall see) over the field K. Let G be a one- 
dimensional subspace of E. Then for any fixed, nonzero element x of G, 
G = {Ax |A in K}. Now assume that there is a continuous, linear func- 
tional ¢ on E such that $(x) = 1. If H denotes the null space of @ then 
H 1s certainly closed and G ~ H = {0}. For any y in E, $(y)x is in G 
and y ~ (y)x is in H. Hence y = $(y)x + [y — o(y)x], and we have 
shown that H is a complement for G in E. 

It is easy to find a continuous, linear functional fon G such that 
f(x) = 1. Simply set f(x) = 1 and define f on all of G by linearity 
(Exercises 1.2, problem 3b). What we need is a continuous, linear 
functional @ on E such that (x) = 1, ie., a continuous, linear func- 
tional on E such that $(y) = f(y) for all y in G. So we shall have shown 
that G has a complement in E once we have shown that every contin- 
uous, linear functional on G is the restriction to G of some continuous, 
linear functional on E. The next theorem proves this and more. It 
implies, in particular, that there are always plenty of continuous, linear 
functionals on any normed space. We stress that in the statement of the 
theorem G need not be finite dimensional. 


Theorem 1 (Hahn-Banach Theorem). Let (E, ||: ||) be a normed 
space over K and let G be a linear subspace of E. Given any contin- 
uous, linear functional fon G there is a continuous, linear functional f * 
on E such that: 


(i) f(x) =f*(x) for each x in G; 
(ii) fl =suptlf@)[l<eG, [xl] <1} = suptl f*0)| [ye 
lly <1} =F" I. 


Proof. Define a new norm on E, p, as follows: p(y) = || f|| ||y|| for 
each y in E. Observe that, for each x in G, | f(x)| < p(x). Now we 
distinguish two cases: 

(a) Assume that K is R, the field of real numbers. Choose a point y 
in E but not in G and let V be the linear subspace of E generated by G 
and y. We shall show that there is a linear functional g on V that agrees 
with f on G and satisfies | g(v)| < p(v) for all v in V. Observe that, since 
p(v) > 0 for all v, we shall have proved this last inequality once we have 
shown that g(v) < p(v) for all v in V. Now V = {Ay + x|Ain R, x in G} 
and g is to be linear, so g is completely determined once we define g(y) 
since g(Ay + x) = Ag(y) + f(x). The problem then, is to define g(y) in 
such a way that the inequality g(v) < p(v) holds for every v in V. 
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If x,, x2 are in G, then 
Sf (x1) +f (%2) =f (%1 + X2) < p(x + x2) 
= pl(x: — y) + (2 + Y)] < PQ — y) + P(x + 9). 
Hence 


— P(x — y) + £1) < Plz + ¥) — F0%2). 
Since x, and x, are arbitrary elements of G we have, taking the sup and 
the inf over G, sup{— p(x — y) + f(x)} < inf{p(x + y) —f(x)}. Thus we 
can choose a real number « that is between this supremum and 
infinum. Choose such an « and set g(y) = a. We shall now prove that 
the functional defined in this way satisfies the required inequality. 
If 4 > 0, 


g(Ay + x) = da + f(x) = Ala + f(x/d)] 
< A[p(x/4 + y) — f(x/A) + f(x/A)] 
= Ap(x/A + y) = p(x + Ay). 
IfA= ~p, p> 0, then 
g(— HY + x) = —pa + f(x) 
= pl~a + f(x/n)] < wlp(x/e — y) — fF (x/H) + F(/t)] 
< up(x/H — y) = p(x — py). 


We have shown that we can extend f, in the required way, to 
subspaces of E that properly contain G. In order to extend f toall of E 
we must appeal to Zorn’s lemma. 

Let e = {(V, g)|V is a linear subspace of E that contains G; g isa 
linear functional on V that agrees with f on G and satisfies |g(v)| < 
p(v) for all v in V}. Partially order ¢ as follows: (V;, g:) < (Vo, gz) iff 
V, < V, and g, agrees with g,; on V,. We now apply Zorn’s lemma to 
prove that there is a maximal element (U, h) of. If U # E then we can 
choose y in E but not in U and then extend h to a linear functional h* 
on the linear subspace W generated by U and y. As we saw above this 
can be done in such a way that h and h* agree on U and |h*(w)| < 
p(w) for all w in W. But then (W, h*) is in «, (U, h) < (W, h*) and 
U + W. This contradicts the maximality of (U, h). 

We have proved the Hahn-Banach theorem for normed spaces 
over the field R. Before proving the theorem for normed spaces over C 
we must make some remarks about vector spaces over C. 
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If V is a vector space over C we can consider maps f from V into C 
such that f(x + y) = f(x) + f(y) for all x, y in V and f(ax) = af (x) for 
all x in V and all real «. Such maps will be called real linear functionals 
on V, If fis a real linear functional on V whose range is contained in R 
then we shall say that fis a real-valued, real linear functional on V. 

(b) Assume now that K is the field C. The given linear functional f 
on G can be written as follows: f(x) = g(x) + ih(x), where g and h are 
real-valued, real linear functionals on G. We want to extend g and hto 
real-valued, real linear functionals g* and h* on E in such a way that 
the functional g* + ih* extends fand satisfies our inequality. The first 
step is to observe that 


glix) + ih(ix) = f (ix) = if (x) = ifg(x) + ih). 
Hence h(x) = —g(ix) for all x in G. Since | g(x)| < | f(x)| < p(x) onG 
there is, by (a), a real-valued, real linear functional g* on E such that 
|g*(y)| < p(y) for all yin Eand g*(x) = g(x) for all x in G. Set f*(y) = 
g*(y) — ig*(iy) for all y in E. Then f* is a complex-valued, complex 
linear functional on E and, for x in G, 


I *(x) = g*(x) — ig*(ix) = g(x) — iglix) = g(x) + ih(x) = f (x). 
To establish our inequality we fix y in E and write f*(y) = re. Then 
| f*(y)| =r = eo" *(y) =f*(e-*y) 
and we can write: 
If*(y)| =F *(e?y) = g*le~*y) = Late" *y) | 
< ple" “y) = |e" | p(y) = p(y). 


Corollary 1. Every finite dimensional subspace of a normed space 
has a complement. 


Proof. Let (E, ||-|) be a normed space, let F be a finite dimen- 
sional subspace of E and let x,,..., x, be a basis for F. For each fixed j, 
1 <j <n, define f,(x;) = 0 for i + j, f(x;) = 1, and extend f, to all of F 
by linearity. Clearly each f; is a continuous, linear functional on F 
(Exercises 1.2, problem 3b). Extend each f, to a linear functional ff on 
E that is continuous on (E, ||-||), and let N(f*) be the null space of this 
extension. Clearly G = (\7_, N(f*) is a closed, linear subspace of E 
and F ~ G = {0}. To prove that G is a complement for F in E we need 
only show that E = F + G. But if ye Ethen )"_, f#(y)x; is in F and 
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y—y%2, f¥(y)x; is in G. Since the sum of these elements is y, we are 
done. 


Corollary 2. Let ( be any 
nonzero element of : eal there is an element f* € E’ such that 


| F*| = 1 and f*(xo) = ||xo |. 


Proof. Let G = {dx |A in K} and define a continuous, linear func- 
tional f on G as follows: f (Axo) = Allxo || for all x = Axo in G, Then 
LF = supt| fe) | fxl|~ ! > is in G, x # 0} = sup{ || |x0 [| Axo 12 
in K, A+ 0} = 1. We may take f* to be any “ norm preserving ” exten- 
sion of f, i.e., any element of E’ whose restriction to G is fand whose 
norm equals that of f- 


Corollary 3. Let (E, ||: ||) be a normed space, let G be a closed, 
linear subspace of E, and let x, be a point of E that is not in G. Let 
d = inf{||x9 — x|||x in G}. Then there is an element f* in E’ such that 
| f*|| = 1, f*(x0) = 4, and f *(x) = 0 for all x in G. 


Proof. Set V = {x + Axo|x in G, A in K}, let f(xo) = 4, f(x) = 
for all x in G, and define fat all other points of V by linearity, Once we 
have shown that f has norm one on V then we can take f* to be any 
element of E’ whose restriction to V is fand whose norm is one, Now 
\f | Ten i )| elo fo in V, v <0} = sup{| f(Axo — x)| Axo — 

x||-'} = sup{|A| dl] Axo — x||- "|x in G, Ain K} = sup{d||xo — x||~ "|x 
in a. d/inf{||xo — x|| |x in G} = d/d=1, 


EXERCISES 2 


1. Let (E, ||-|}) be a normed space over K. Let x be any nonzero 
element of E. Show that there is an element fe E’ such that 
f(x) #0. The null space of a linear functional on E is called a 
hyperplane in E (see Section 1.3, Lemma 1, and Exercises 1.3, 
problem 4), Show that any closed, linear subspace of (E, || ||) is the 
intersection of the closed hyperplanes that contain it. 


2. Let (E, || ||) be a normed space and let {x,} be a sequence of points 
of E. We shall say that {x,} is a weak Cauchy sequence if { f(x,)} is 
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a Cauchy sequence for each fin E’, We shall say that {x,} is weakly 

convergent to the point x, of E if lim f(x,) = f(x) for every fin E’, 

Finally, we shall say that (E, | - ||) is weakly (sequentially) complete 

if every sequence of points of E that is a weak Cauchy sequence is 

weakly convergent to a point of E. 

(a) If {x,} is weakly convergent to xo € E and also to yo € E, 
show that x9 = yo. 

(b) Show that a weakly complete normed space is a Banach 
space, 

(c) Show that any closed, linear subspace of a weakly complete 
Banach space is itself weakly complete. 

(d) If the Banach space (E, ||-||) is weakly complete and if (F, 
| || -|| |) is topologically isomorphic to (E, ||-||), show that F is 
weakly complete. 

(e) Show that (J,, ||-||,) is weakly complete. Hint: Look over the 
proof of Lemma 1 (Section 1). 


3. The Banach-Steinhaus Theorem 


A set ( of continuous, linear functionals on a normed space (E, ||: ||) 
can be “ bounded ” in at least two different senses, First, since E’ has a 
norm the set can be bounded for this norm; i.e., sup{|| f || | fin ©} can be 
finite. If this is the case then we shall say that @ is a norm bounded set. 
It can also happen that sup{| f(x)| | fin ©} is finite for each x in E. 
When this is true we shall say that ( is pointwise bounded on E. A 
norm bounded set in E’ is certainly pointwise bounded on E. The 
surprising fact is that, if (E, ||-||) is complete, then the converse is true. 


Theorem { (Banach-Steinhaus Theorem). Let (B, ||-||) be a 
Banach space. Then a subset of B’ is norm bounded iff it is pointwise 
bounded on B. 


Proof. Let @ bea subset of B’ that is pointwise bounded on B, We 
may assume that is countable, and so we may write © = {f,|n = 1, 2, 


We shall now show that to prove that {f,} is norm bounded it 
suffices to prove that there is an xo in B,a dé > 0,andak > Osuch that 
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| f,(x)| <& for all n and all x in {x € B|||x ~ xol| < 6}. It is conve- 
nient to denote this set by #4(6, xo). Suppose that this condition is 
satisfied for an xp) in B and numbers 6, k. Let x be a point of B with 
|x| < 6. Then 


| fulx) | < | fale + Xo) —fa(%o)| < | Sal + X0)| + | flo) | < 2K 


for every n because ||(x + Xo) — Xo || = ||x|| < 6. Thus |_f,(x)| < 2k for 
every nand every x in the set -4(6, 0). Now if y is any nonzero point of 
B, then dy'l||~! is in #(d, 0). So | f,(y)| < 2k||y|]67* for all n. Then 
clearly || f, || < 2k5~' for every n. 

Now suppose that for any ball ” (e., any set of the form 4(6, xo)) 
and any k > O there is an integer n and a point x in ¥ such that 
| f,(x)| = k. Choose a ball Y, a point x, € , and an integer n(1) such 
that | fyaj(x1)| > 1. Since f,,,, is continuous this inequality is satisfied 
at each point of a ball “, contained in ” and containing x, whose 
diameter is less than 2~ '. By our assumption there is a point x, € .%, 
and an integer n(2) such that | f,,2(x2)| > 2. As before, this must hold 
at each point of some ball “, contained in “, and containing x, 
whose diameter is less than 2~ 7. Now choose x3; € 2 and an integer 
n(3) such that | f,,3,(x3)| > 3. Using the continuity of f,;, we find a 
ball.” contained in .”, and containing x, such that | f,,3,(x)| > 3 for 
all x € “, and the diameter of .; is less than 2~ >. Continue in this 
way. After .%;,.7%2,..., L,—, have been chosen, choose x, € “,-, and 
an integer n(k) such that | f,q)(x,)| > &. By the continuity of f,, this 
inequality must hold at each point of a ball“, contained in “,_ , and 
containing x, whose diameter is less than 2~*. 

Now we use the fact that (B, ||-||) isa Banach space. Because of this, 
the set () 1 ¥, is not empty. But if y is a point in this intersection, then 
| fuu()| > & for k = 1, 2, ..., contradicting the fact that @ = (f,} is 
pointwise bounded on B. 


This theorem has many important applications. We shall discuss 
some of these later on (Chapters 5 and 6). Right now let us show that 
the theorem need not be true for normed spaces that are not complete. 

Let F be the linear subspace of J, consisting of all sequences that 
have only a finite number of nonzero terms. Clearly, F is dense in (1,, 
||- 1). For each fixed, positive integer n let f,({t,}) = t, for each {1,} in F. 
Clearly, f, € F’ and || f, || < 1 for every n. Consider {nf,} c F’. For any 
{t,} in F it is clear that nf,({t,}) = nt, = 0 for n sufficiently large. It 
follows that {nf,\ is pointwise bounded on F. But |\nf, || > | nf,(e,)| =n, 
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where e, is the sequence having one in the nth position and zeros 
elsewhere. Thus {||nf, ||} is not a bounded set. 


EXERCISES 3 


1. Referring to-the first part of the proof of Theorem 1, why can we 
assume that the set © is countable? 

2. Let (B, ||- ||) be a Banach space, let (E, |||- |||) be a normed space, 
and let S be a subset of ¥(B, E) (Exercise 3.1, problem 5). If, for 
each x in B, the set {Tx | T in S} is bounded in (E, | ||- || |), show that 
there is a positive constant M such that ||| Tx|| | < M||x|| for all x 
in B and each T in S. 

3. Let (B, ||-||) be a Banach space and let {f,! be a sequence in B’. 
Suppose that lim f,(x) exists for each x in B and, for each x, define 
g(x) to be this limit. Show that g € B’. 

4. Let (E, ||-||) be a normed space and let S be a subset of E. Show 
that S is bounded in (E£, ||- ||) iffsup{| f(x)| |x in S} is finite for each 
fin EB. 


4. The Completion of a Normed Space. 
Reflexive Banach Spaces 


The dual of the normed space (E, ||- ||) is the Banach space E’. This 
space also has a dual. It is usually denoted by E”, is called the bidual of 
(E, ||: ||) and consists, of course, of all continuous, linear functionals 
on E’. For each fixed x in E define %(f) to be f(x) for all f in E’. It 
is clear that xX is a linear functional on £E’, and_ since 


IX(f)| = | f(x)| < Fl |x|] we see that % is in E”. Hence we can 
define a map ¢ from E into E” by letting @(x) = x for each x in E. This 
map is linear and ||@(x)|| = ||x|| for each x in E (Section 2, Corollary 2 


to Theorem 1). So @ is an equivalence (Section 1, Definition 2) from (E, 
||: ||) onto a linear subspace of E”. We shall call ¢ the canonical embed- 
ding of (E, ||-||) into E” and we shall often identify E with its image in 
E”. These observations have an immediate application. 
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Theorem 1. Every normed space is equivalent to a dense, linear 
subspace of a Banach space. 


Proof. Let (E, ||-||) be a normed space, let ¢ be the canonical 
embedding of (E, ||-||) into E’, and let @(£) be the image of E in E” 
under @. Clearly (E, ||- ||) and @(£) are equivalent and $(E) is a dense, 
linear subspace of its closure cl P(E) in (E’, ||-||). But (£”, ||-||) is a 
Banach space (Section 1, Theorem 1). Hence cl #(E) is also a Banach 
space. 


Definition 1. A Banach space is said to be a reflexive Banach 
space if the canonical embedding maps the space onto its bidual. 


If B is a reflexive Banach space, then the canonical embedding is an 
equivalence from B onto its bidual. There are nonreflexive Banach 
spaces that are equivalent to their biduals [12]. Of course, in such a 
case, the equivalence is not the canonical map. 

We have already seen that the dual of a separable Banach space 
need not be separable (Exercises 1, problem 1a). However: 


Theorem 2. Let (E, ||-||) be a normed space and suppose that E’ is 
a separable Banach space. Then (E, ||: ||) is separable. 


Proof. Let S={f in E’|||f|| = 1}. We can choose a sequence f,, 
fy, ... that is dense in S. For each n choose x, in E with ||x,, || = 1 and 
| fa(x,)| > 3. Let G be the closure of the linear subspace of E generated 
by the set {x,}. We shall show that G = E. Suppose that there is a point 
Xp that is in E but not in G. By the third corollary to the Hahn—Banach 
theorem (Section 2) we can find an element g of E’ such that g(xo) # 0 
but g(x) = 0 for all x in G. We can also assume that ||g|| = 1. Now 


3< | ful%n) |< | fnl%n) — 9(%n)| + [90%n)| < ta — ll [lXnll = fn — ll 


for every n. But since g € S and { f,} is dense in this set we have reached 
a contradiction. So G = E and, using this fact, we shall show that (E, 
||: ||) is separable. 

Suppose that E is defined over the field R. Let Y = {)j-, a,x, |nis 
finite; «,, 02, ..., a, are in R} and let # = {}"_, q;x,|n is finite; q,, 
42> -++, 4, are rational numbers}. It is clear that 4 is dense in G and that 
H is a countable set. Now given )4-, a,x; in Y and « > 0 we may 
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choose rational numbers q,, ..., q, such that |a,;~ q;| </n for 
1<j<n. Then )"_, q;x, is in # and |¥ a,x; — Y q,;x;|| < ¢ Hence 
# is a countable, dense subset of (E, ||- ||). 

If E is defined over the field C the proof is similar to the one just 
given and we leave it to the reader. 


EXERCISES 4 


*1. Let (E, ||: ||) be a normed space. A Banach space that has a dense, 
na ‘subspace that is equivalent to (E, ||-||) will be called a 
completion of (E 
(a) Show As any two completions of (E, ||: ||) are equivalent. 
(b) If (B, ||- ||) isa completion of (E, ||- ||), aeere and E’ are 

PA 


2. Tosolve this problem one has to use some facts from rea] variable 

theory (see [9] or [21]). 

(a) Let Y be the space ofall polynomial functions on [0, 1]. For 
each fin ¥ let || f |, = sup{| f(x)| |O < x < 1}. Identify the 
completion (up to equivalence, of course) of (Y, ||-||..) 

(b) For any fixed, real number p > | define a norm on @[0, 1] as 
follows: For each f in @[0, 1] let || f||, be the pth root of 
fo | f(x) |? dx. Identify the completion of (¢[0, 1], |{-|[,)- 

3. (a) If(B, ||-|]) isa reflexive Banach space show that (B’, ||-||) isa 
reflexive Banach space. 

(b) If (B, ||-||) is a separable, reflexive Banach space show that 
every dual space of (B, ||-||) (ie., B’, B’, (B’Y’, etc.) is a separ- 
able Banach space. 

(c) Show that (co, ||-||,.) and (I,, ||-||,) are not reflexive Banach 
spaces. 


4. Let (E, ||-||) be a normed space and let fe E’ have norm one. For 
any ¢ > 0 show that there is an x, in E with ||x, || = 1 and f(x,) > 
1 — e. Give an example to show that there need not bean xg in E 
such that ||xq || = 1 and f(x) = 1. Hint: Consider (I, ||-|],) and 
its dual (1,,, ||-||.)- 


CHAPTER 4 


The Weak Topology 


1. Topology from a Family of Seminorms 


We come now to one of the most fascinating topics in the theory of 
normed spaces. This is the investigation of the weak topology and its 
relatives. In order to treat the subject properly we shall have to intro- 
duce new concepts and prove some peripheral, but interesting, results. 
However, most of this material will be used again, especially in the last 
chapter. An example of the kind of problem that we can solve using the 
ideas developed here is this: We know that I,, is the dual of /,, and that 
I, is the dual of cg. What about cy; what space, if any, is it the dual of? 
More generally, given a Banach space B,, is it always possible to find a 
Banach space B, such that B, and By are equivalent? This problem is 
solved in Chapter 5. 


Definition 1. A real-valued function p on a vector space X is said 
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to be a seminorm on X if: 


(i) p(x + y) < p(x) + p(y) for all x, y in X. 
(ii) p(ax) = |x| p(x) for all x in X and all scalars «. 


For example, if fis a linear functional on X then we can define a 
seminorm on X by setting p,(x) = | f(x)| for all x in X. In this way we 
obtain a whole family of seminorms on X. 


Lemma 1. Let p be a seminorm on X. Then p(0) = Oand | p(x) — 
P(y)| < p(x — y) for all x, y in X; in particular, p(x) > 0 for all x. 


Proof. p(0) = p(Ox) = Op(x) = 0 by property (ii). By (i) we have 
p(x — y) + p(y) = p(x) or p(x — y) = p(x) — p(y). But 


p(x — y)= |—1|p(y — x) = p(y) — p(x) = — {p(x) — ply)}. 
Hence we have our result. 


Let X be a vector space and let {p, | in I} be a family of seminorms 
on X. There is a standard method of defining a topology on X by 
means of this family. We will give this method in three steps that will 
be referred to, collectively, as the construction process. 

(a) Let ¥ be the family of all subsets of X that are formed in the 
following way: Choose a finite subset p,, pz, ..., P, of {p,}, the 
same number of positive real numbers ¢,, €,, ..., €,, and let 
V = V(Dq, «+5 Pai 1s «++ En) = {x in X | px) < e; for 1 <j <n}. 

(b) For any point x of X we shall say that a set U containing x is a 
neighborhood of x if there is some V € ¥ such thatx + V CU. 

(c) Let t = t({p,}) be the family of all subsets of X that are neighbor- 
hoods of each of their points. 


Lemma 2. The family of sets t = t({p,}) is a topology on X and 
each p, is continuous on X for this topology. The topology is Haus- 
dorff iff {p,} satisfies the following: (Separation Condition) For each 
nonzero x in X there is some p, such that p,(x) # 0. 


Proof. It is clear that X itself and the empty set are in t, We have 
to show that the union of any family of sets in t is a set in t, and that the 
intersection of any finite family of sets in t is a set in t. The first of these 
is clearly true. Let {O,|j = 1, 2,..., } be a finite family of sets in ¢. If the 
point x is in the intersection of these sets then for each j there is a set V, 
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in ¥ such that x + V, <O,. To prove that (\"_ , O; is a neighborhood 
of x it is sufficient to prove that (\"_, V; is in ¥. But this is obvious. 

Choose any p,. It is clear, from Lemma 1, that p, is continuous on 
X iff it is continuous at zero. So given ¢ > 0 we have to show that for 
some neighborhood, say V, of zero, p,(x) < ¢ for all x in V; i.e., we have 
to find some Ve ¥° such that p,(x)<e for all x in V. But {x in 
X |p,(x) < 6} is in ¥° by definition, and so p, is continuous at zero, 
hence on all of X, for the topology t. 

Now let us prove the last statement. Assume that for x # 0 in X 
there is some p, such that p,(x) # 0. Then, if x, y are in X and x ¥ y, 
there is some p, such that p,(y—x)>0. So p,(y)> p,(x). Let 
d= p,(y) — p,(x) and let V={z in X|p,(z) < d/2}. We claim that 
x + V and y+ V are neighborhoods of x and y, respectively, that are 
disjoint. To prove this let z belong to both of these sets. Then 
z—x eV and z— ye V,and so p,(z — x) < d/2 and p,(z — y) < d/2. 
But then 


p(y — x) < p,(y — 2) + p,(2— x) <d, 


which is a contradiction. So the separation condition does imply that t 
is Hausdorff. The converse is easy. 


Remark. Let X bea vector space, let {p,} be a family of seminorms 
on X, and let t = t({p,}). The space X with the topology t will be 
denoted by X[r]. A continuous, linear functional on X[t] is said to be a 
t-continuous, linear functional. Similarly, we shall speak of t- 
neighborhoods of zero in X, t-compact sets, t-convergent sequences, 
etc. 

If (E, ||- ||) is anormed space and E’ is its dual space, then the family 
of seminorms {p,| fin E’} (recall that p,(x) = | f(x)| for all x in E)on 
E satisfies the separation condition (Section 3.2, Corollary 2 to the 
Hahn-Banach theorem). The Hausdorff topology t({p,}) will be 
denoted by a(E, E') and will be called the weak topology on E. 


A typical o(E, E')-neighborhood of zero contains a set of the form 
{x in E| | fi(x)| <, for 1 <j <n} (see (a) and (b) of the construction 
process). This last set contains a sufficiently small ball centered at zero; 
1.€., there is a 6 > 0 such that 


V = {x in E| | fi(x)| <e, for 1 <j <n} > {x in E|||x|| < 6}. 


Hence, by (b) and (c) of the construction process, every o(E, E’)-open 
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subset of E is open for the norm topology. Notice that V contains 
(Vie. {x in E| f(x) = 0}. This intersection is a linear subspace of finite 
codimension in E (Exercises 2.2, problem 6). Suppose that the norm 
and the weak topologies on E were to coincide. Then the unit ball of E, 
which is a norm neighborhood of zero, would have to contain a sub- 
space of finite codimension in E. Now the only linear subspace of E 
that is contained in the unit ball is the zero subspace. This will have 
finite codimension in E iff E is finite dimensional. Hence we have 
proved: 


(1) On an infinite dimensional normed space the weak topology is 
strictly weaker than the norm topology. 


By Lemma 2 each f in E’ is o(E, E’)-continuous on E. Combining 
this with (1) we have: 


(2) The space of all weakly continuous, linear functionals on a normed 
space E coincides with E’. 


If fis any element of E’ and N(f) is the null space of f, then N(f) is 
a linear subspace of E that is closed for both the weak and the norm 
topologies. Let H be any norm closed, linear subspace of E. If x € E, 
x € H, then there is, by Corollary 3 to the Hahn-Banach theorem, an 
element f of E’ such that f(x) # 0 and f(y) = 0 for all y in H. Define H* 
to be {fin E'| f vanishes on H}. Then H = (\ {N(f)| fin H*}, and so 
H is closed for the weak topology; i.e., we have shown: 


(3) A linear subspace of a normed space is closed for the weak topology 
iff it is closed for the norm topology. 


Now consider the dual space E’ of the normed space E. This has a 
norm and a weak topology also (ie., a(E’, E”)). There is, however, 
another useful topology on E’. For each fixed x in E define p,(f) to be 
|.f(x)| for all f in E’. The family of seminorms {p,|x in E} defines a 
Hausdorff topology on E’, which we shall call the weak* topology on 
E’. This topology is written o(E’, E). 

Since E < E” (Section 3.4) the construction process shows that 
o(E’, E) is weaker than o(E’, E"). We can say more. But first we shall 
prove: 


(4) The space of all weak* continuous, linear functionals on E’ coincides 
with E. 


To prove this let @ be a o(E’, E)-continuous, linear functional on 
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E'. Then {fe E’||@(f)| < 1} contains a o(E’, E)-neighborhood of 
zero. Hence there is a finite set x,;, x2,..., X, in E and positive numbers 
£1, €2,...,€, Such that |@(f)| < 1 whenever fis in {g € E’| |g(x,)| <¢; 
for 1 <j <n}. In particular, if N(x,) is the null space in E’ of the 
functional x; (see Section 3.4 for the notation x,), |@(f)| < 1 when- 
ever fe (\f-, N(x,). But if fis in this intersection, then so is Af for all 
scalars A. Thus |(A4f)| <1 for all 4 and this implies $(f) = 0, ie., 
N(¢) > (\j-1 N(&;). It follows that is a linear combination of x,,..., 
x, (Exercises 2.2, problem 6) and so ¢ € E. 


Since the space of all o(E’, E")-continuous, linear functionals on E’ 
coincides with E” (by (2)) we have: 


(5) The topology o(E’, E) is weaker than o(E', E") and when E # E" 
these topologies are distinct. 


A linear subspace of E’ that is norm closed need not be weak* 
closed, but we can say something about its weak* closure. We need 
some notation first. For anyJitiear subspace M of E’ let M, = {x in 
E| f(x) = 0 for every fin M} and let (M,)' be { fin E’| f(x) = 0 for all 
x in M,}. It is clear that both M, and (M)' are linear subspaces. Also, 
since M, = () {N(f)| fin M} and (M_)' = () {N(x)|x in M,}, M, is 
closed in E and (M,)" is weak* closed in E’. 


Lemma 3. The weak* closure of any linear subspace of M of E’ 
coincides with (M_,)*. 


Proof. Since M <(M,)' all we have to do is show that if fo is not 
in the weak* closure of M then it is not in (M,)*. Assume that fo in E’ 
is not in the weak* closure of M. We shall find a point x9 of M, such 
that fo(xo) # 0. Our assumption implies that there is a weak* neigh- 
borhood of f, that does not meet M;i.e., there is a finite set x,,..., x, in 
E and « > 0 such that no point g € M can satisfy |g(x;) — fo(x;)| <« 
for | <i <n. Define a map ¢ from E’ into K" by letting @(g) = (g(x;), 
.., 9(X,)) for every g € E’. Clearly ¢(M) is a linear subspace of K” and 
(fo) is not in this subspace. Thus there is a linear functional on K” 
that is zero on ¢(M) and is not zero at #(fo) (by the Hahn-Banach 
theorem, Corollary 3); i.e., there are constants c;,c2,..., Cc, such that 
Yc, g(x;) = 0 for all g € M and Yc; fo(x;) # 0 (Exercises 1.3, problem 
5). Let xo = }ic;x; and note that our last statement becomes: 
g(x) =0 for all g in M (hence x9 €M,) and fo(x9) #0 (hence 
fo € (M,)*). 
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Suppose that @ is in E” but is not in E. Then N(@) = {f in 
E'|o(f) =0} is a norm closed, linear subspace of E’ whose 
o(E’, E)-closure is (N(@),)'. Now N(@), = {x in E| f(x) = 0 for every 
fin N(@)}. If x € E is in this set then x = A@ (Exercises 1.3, problem 4). 
But ¢ ¢ E and so this is possible only for A = 0; .e., N(@), is the linear 
subspace of E whose only element is the zero vector. Clearly then 
(N(@),)' is all of E’ and so N(@) is o(E’, E)}-dense in E’. We have 
proved: 


(6) If E # E", then there are linear subspaces of E’ that are both norm 
closed and weak* dense in E’. 


The next theorem exhibits another important difference between 
the weak and weak * topologies. This result has many applications and 
we shall discuss some of these later on. 


Theorem 1 (Alaoglu’s Theorem). The unit ball, in the dual of any 
normed space, is compact for the weak* topology. 


Proof. Let (E, ||-||) be a normed space over K and, for each x in E, 
let K(x) be K. An element 6 of [] {K(x)|x in £} is a function from E, 
the index set, into K. Hence, it makes sense to speak of 6(x). Every 
element of E’ can be regarded as a point in the product space; i.e., there 
is a map from E’ into |] {K(x)|x in E}. Identify E’ with its image in the 
product space under this map. Notice that, since E is the index set for 
the product space, the product topology restricted to E’ is just o(E’, E). 

Let &’ be the unit ball of E’ and, for each x in E, let D(x) = {z in 
K||z| < ||x|}. If g © # then, for any x, |g(x)| < ||g|| ||x|| < |x|], and 
so &’ is contained in the compact set [| {D(x)|x in E}. If we can show 
that #’ is closed in this product, we shall be done. Let 6 be a point in 
[] {P(x) |x in E} that is in the closure of 4’. The first thing we shall do 
is show that 0 € E’. Given ¢ > 0 and x, y in E we can find g € #' such 
that 


|g(x) — A(x)| <e, | g(y) — Ay) | <a, 
and 
|g(x + y) — A(x + y)| <e 


because @ is in the closure of 4’ for the product space topology. Now g 
is linear and so we get |O(x + y) — 0(x) — A(y)| < 3« and, since ¢ was 
arbitrary, 0(x + y) = 0(x) + O(y) for all x, y in E. In a similar way one 


1. TOPOLOGY FROM A FAMILY OF SEMINORMS 61 


can show that 6(ax) = «6(x) for all w in K and all x in E. So 6 is linear. 
Recall now that @ € [] {D(x)|x in E}. This means |6(x)| < ||x]| for all 
x in E and so the linear map 0 must be continuous on E. In fact, 0 € #. 


For a reflexive Banach space (Section 3.4, Definition 1) B the weak 
and weak* topologies on B’ coincide; i.e., ¢(B’, B) = o(B’, B’) because 
B= B". More is true in this case. Since B = B" we must also have 
B' = B"’. Hence a(B, B’) and o(B", B’') = o(B", B’) coincide on B. 
This says that, when B is a reflexive Banach space, the weak topology 
on B is actually a weak* topology. Applying Alaoglu’s theorem we 
have: 


Corollary 1. The unit ball of a reflexive Banach space is compact 
for the weak topology. 


We shall investigate the converse of Corollary 1 later on. 


EXERCISES | | 


#1. Let X bea vector space over K and let {p,} be a family of semi- 

norms on X. We refer to step (a) of the construction process. 

(a) Show that, if Uey, there is a set Ve¥ such that 
VtiVcU. 

(b) If Ue ¥ show that there is a set V € ¥ and a neighbor- 
hood N of zero in K such that aV c U for all « in N. 

(c) Let t= t({p,\). Show that a sequence {x,} cX is t- 
convergent to x € X iff lim p,(x — x,) = 0 for each y. 


«2. Let (E, ||- ||) be a normed space. We refer to Exercises 3.2, problem 


(a) Show that {x,} < E is a weak Cauchy sequence iff for every 
o(E, E')-neighborhood V of zero in E there is an integer N 
such that x, — x,, € V whenever both m,n > N. 

(b) Show that {x,} cE is weakly convergent to xe E iff 
lim f(x — x,) = 0 for every fin E’. 

«3. Let (E, ||- ||) be a normed space and let S be a subset of E. We shall 
say that S is a total subset of E iff E’ and f(x) = 0 for all x eS 
implies f = 0. 
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(a) Show that S is a total subset of E iff the linear subspace 
generated by S is dense in E. 

(b) Show that (E, ||-||) is separable iff it contains a countable, 
total subset. 


Let (E, ||-||) and (F, |||-|||) be two normed spaces and suppose 

that u is a linear map from E into F. Define a map u* from F' into 

E’ as follows: For each ¢ € F’, u*(@) is the element of E’ defined 

by u*(u)(x) = ¢[u(x)] for all x in E. This is called the adjoint of u. 

(a) Show that u* is linear. If u is continuous prove that u* is 
continuous when E’ and F’ have their norm topologies. If u 
is continuous show that ||u|| = ||u*}} and also that u* is con- 
tinuous when E’ and F’ have their weak* topologies. Hint: 
For each fixed x € E we have 


| |ux)| | = sup{ | o[u(x)]| 16 € F’, ol] < 1. 


But ¢[u(x)] = u*(p)(x) by definition. Thus |lu(x)|) < 
sup{|u*(p)(x)||¢eF, dl) <H. It follows that 
|u(x)|| < fuel xf, and so ful) < ut]. The reverse 
inequality is easy to prove. 

(b) Ifwu is an equivalence from E onto F (Section 3.1, Definition 
2) show that u* is an equivalence. 


Let (E, ||-||) be a separable normed space. Show that any se- 
quence in E’ that is bounded for the norm of E’ has a subsequence 
that is o(E’, E)-convergent. Hint: Let {f,} be a bounded sequence 
in the Banach space E’ and let {x,} be a countable, dense subset of 
(E, ||- ||). For each fixed j the set {f,(x,)|n = 1, 2,...} is bounded in 
K and hence has a convergent subsequence. For an interesting 
and useful application of this result see [27, Theorem 2b, p. 103]. 


Sets Which Define Seminorms 


Seminorms arise in another, more geometric, way. Let X be a 


vector space over the field K and let A be a subset of X that contains 
the zero vector. Suppose that x € X and that x is in aA = {ay|y € A} 
for some positive scalar «. In this case we define p(x) to be inffa > 0|x 
is in &A}. If x is never in a multiple of A then we set p,(x) = +00. The 
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function p, from x into R U {+00} is called the gauge function of A. 
Notice that if A > 0, p,(Ax) = Ap,(x) for any x. 


Definition 1. A subset A of a vector space X is said to be a convex 
set if for any two points x, y of A and any real number a, 0 <a < 1, the 
point ax + (1 —a)y is in A. 


Lemma 1. Let A be a convex set that contains the zero vector and 
let p, be the gauge function of A. Then p,(x + y) < pa(x) + py(y) for 
all x, y. 


Proof. For any positive numbers A and y we have (A + p)A < 
AA + pA. Since A is convex, 


A Ja+( # Ja A 
= ,-— JA cA. 
A+ q A+ pL 


Hence, for a convex set A, (A+ w)A = AA + BA. 

Our inequality is certainly satisfied if p(x) or p4(y) is + 00. Assume 
that p,(x)=s and p,(y) = t, where both are finite, and let ¢ > 0 be 
given. We can choose 4, pt such that 


s<A<s+te, x isin AA 
and 
t<u<tt+e, yis in pA, 
It follows from this that x+y is in AA + pA=(A+y)A, and so 
pa(x + y) <s +t + 2¢. The inequality follows from this. 
Definition 2. Let A be a subset of the vector space X. 


(a) We shall say that A is a balanced set if “A c A for all scalars « 
such that |a| <1. 

(b) We shall say that A is an absorbing set if for any x in X there 
is some scalar a > 0 such that aA contains x. 


Observe that a balanced set always contains the zero vector and 
that the gauge function of an absorbing set is a real-valued function. 


Lemma 2. The gauge function of a balanced set A satisfies: 
p(Ax) = |A|p,4(x) for all scalars 4 and all vectors x. 


Proof. Since the equation is true for all A > 0 we need only prove 
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it for scalars A such that |A| = 1. But if |A| =1 then, since A is 
balanced, a vector x € A iff it belongs to AA. 


The following theorem summarizes our results so far. 


Theorem 1. Let X be a vector space over K. The gauge function of 
an absorbing, balanced, convex subset of X is a seminorm on X. 
Conversely, if p is a seminorm on X, then the set A = {x| p(x) < 1} is 
an absorbing, balanced, convex set such that p, = p. 


EXERCISES 2 


1. Let X be a vector space over K. 


(a) 


*(b) 


Prove that the intersection of any family of convex (respec- 
tively, balanced) subsets of X is a convex (respectively, bal- 
anced) subset of X. 

Given a subset S of X define the convex hull of S to be the 
intersection of the family of all convex subsets of X that 
contain S. Show that the convex hull of S is {)%_, a;x,|nis 
a positive integer; x,,..., Xx, are in S;a,,..., %, are nonnega- 
tive numbers with )"_, a; = I}. 

Define the balanced, convex hull of S to be the intersection 
of the family of all balanced, convex subsets of X that con- 
tain S. Show that this is equal to {}%_, a;x,|n is a positive 
integer; x,,..., x, are in S; a,,..., a, are elements of K with 
Vi=1 [oj] < Up 

Define the balanced hull of S in the natural way (see (b) and 
(c)). Show that the balanced, convex hull of S is equal to the 
convex hull of the balanced hull of S, but that it need not 
equal the balanced hull of the convex hull of S. 


2. Let (E, ||-||) be a normed space over K, and let # be the unit ball of 
this space. 


(a) 


(b) 


Show that a balanced, closed, convex subset C of (E, ||- ||) is 
the unit ball corresponding to some norm on E that is 
weaker than ||-|| if, for some a > 0, a4 <C. 

If, in addition to the conditions on C stated in (a), we 
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assume that the set is bounded, then show that the gauge 
function of C is a norm on E that is equivalent to |- |). 

(c) Let (B, ||-||) be a Banach space and let C be an absorbing 
balanced, bounded, closed, convex subset of B. Show that 
the gauge function of C is a norm on B that is equivalent to 


II. 


3. Locally Convex Spaces. Kolmogorov’s Theorem 


Here we shall examine the topology defined by a family of semi- 
norms in some detail. Throughout this section X will be a vector space 
over K, {p,|y in I} a family of seminorms on X, and t the topology 
t({p,}). We invite the reader to look over the construction process given 
just after Definition 1 in Section 1. In particular, recall that any t- 
neighborhood of, say xo € X, contains a set of the form x) + V, where 
Ver. 


Lemma |. We consider the space X[t] and we give X x X,K x X 
their respective product space topologies. Then: 


(i) The map from X x X into X that takes each pair (x, y) onto 
x + y is continuous. 

(ii) The map from K x X into X that takes each pair (a, x) onto 
ax is continuous. 


Proof. If Xo, Yo in X and a t-neighborhood W of xo + yo are 
given, we can find U € ¥° such that x9 + Yo + U c W. By problem la 
of Exercises 1, there is a Vey such that V+VcU. Now 
(xo + V) x (yo + V) is a neighborhood of (xo, yo} in X x X and our 
map takes the neighborhood to x5 +V+yo +V Cx 9+ yot 
U c W. This proves (i). 

Now let a € K, Xo € X, and a neighborhood W of a Xo be given. 
We want to find a neighborhood N of a in K and a neighborhood 
U,(xo) of xo in X such that (ax — a xo) € W whenever (a, x) e N x 
U(x). There is aset V € ¥° such that a x9 + V c W, and we can find 
another set U e ¥ such that U +U+U cV (Exercises 1, problem 
la). The set U is balanced and absorbing (Section 2, Theorem 1) and so 


(1) if x — xo € U, then a(x — x9) € U for all a with |a| <1; 
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(2) there is a number ¢>0 such that ax, € U for all « with 
|a| <e. 


Suppose (we shall prove this in a moment) that we can find a set 
U, € ¥’ such that 


(3) Xo U, cU, 


and let U, be any element of ¥' that is contained in U, 1 U. Set 
N ={aeK||a—a| <min(1,¢)} and set U,(xo)=xo+U;. If 
(a, x)€N x U,(xo), then (a — a%)xo € U by (2), a(x — xo) Ee U by 
(3) and the fact that (x — x9) € U, c U4, and (a — a)(x — xo) € U by 
(1) and the fact that (x — x9) e U, c U. But 


AX — Hy Xq = (% — aq)xXo + a(x — Xo) + (% — Ho)(x — Xo) 


and so ax — aX isinU+U+UcYV. 

We shall now complete the proof by showing that for any V € 7° 
and any a € K there isa set U € ¥° such that a U c V. We know that 
there is a set Ue ¥ with U+U cV. Hence, by induction, we can 
find, for any integer n, a set U, € ¥° such that 2"U, < V. Choose nso 
that |a | <2”. Then, since U,, is a balanced set, a2°-"U < U. Thus 
AU c2UCY. 


Definition 1. Let X be a vector space over K and let s be any 
topology on X. We shall say that s is compatible with the vector space 
structure of X and that X[s] is a topological vector space, if X with the 
topology s satisfies conditions (i) and (ii) of Lemma 1. 


A normed space with its norm topology is a topological vector 
space; this is, since a norm is a seminorm, a special case of Lemma 1. 
Observe that if X[s] is a topological vector space and xq is any fixed 
point of X, the map that takes each x in X to x + Xo is a homeomor- 
phism. Hence the s-neighborhoods of any point are just translates of 
the s-neighborhoods of zero and, just as for normed spaces, we can 
compare compatible topologies on a vector space by comparing the 
neighborhoods of zero in these topologies. 

Now the only topological vector spaces that we have seen are those 
whose topologies could be defined by means of a family of seminorms. 
We may ask whether the topology of every topological vector space 
arises in this way. More precisely, given any topological vector space 
X[s], does there exist a family of seminorms {p,} on X such that 
s = t({p,})? This is what we will mean if we say that the topology on a 
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certain X[s] can be defined by a family of seminorms. The answer to 
our question is, in general, “no” [16, p. 156], but we can give a nice 
characterization of those spaces for which the answer is “ yes.” 


Definition 2. A topological vector space X[s] is said to be a locally 
convex space if every s-neighborhood of zero in X contains a convex 
s-neighborhood of zero. 


It is easy to see that if t is defined by a family of seminorms, then 
X(t] is a locally convex space. 


Lemma 2. Let X[s] be a locally convex space. Then every s- 
neighborhood of zero in X contains an s-neighborhood of zero that is 
an absorbing, balanced, convex, s-open set. 


Proof. Let U be any s-neighborhood of zero. Clearly, U contains 
an open s-neighborhood of zero (the interior of U, for example), so let 
us assume that U is open. If x9 is in X then clearly 0x € U and hence 
there is a neighborhood N of 0 in K such that ox e€ U for alla in N; 
i.e, there is a positive number f’ such that ax9 € U if |a| < fp’. From 
this we see immediately that U is absorbing since xo € (1/a)U when- 
ever & is a positive number that is less than pf’. 

Now the zero vector is in U and so there is an s-neighborhood V of 
zero in X and a neighborhood N of zero in K such that N x V cU. 
Clearly N can be taken to be {a in K||a| < f’} for some positive 
number f£”. Choose, and fix, a positive number f such that. B < B”. 
Then aV <U if |a| < f. Then choose an s-neighborhood Vo of zero 
such that (1/B)M) cV. If aw is in K and |a| <1, then 
aV = aB(1/B)Vo < (aB)V <U because || < B. Thus the balanced 
s-neighborhood (} {#V)| |a| < 1} is in U. 

We have seen that U is absorbing and that U contains a balanced 
s-neighborhood of zero; call it U,. Since X[s] is a locally convex space 
we can find a convex s-neighborhood U, of zero that is contained in 
U,. If V is the balanced, convex hull of U, (Exercises 2, problem Ic), 
then V is an absorbing, balanced, convex s-neighborhood of zero that 
is contained in U. But the interior of V also has these properties and it 
is clearly an open set. This proves the lemma. 


Theorem 1. The family of all topological vector spaces whose 
topologies can be defined by a family of seminorms coincides with the 
family of all locally convex spaces. 
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Proof. We need only prove the sufficiency of this condition. Let 
X[s] be a locally convex space and let ¥ be the family of all absorbing, 
balanced, convex, open neighborhoods of zero in X. For each V in ¥” 
let Py be the gauge function of V, and let t = ¢({P,|V in ¥}). Then 
X[t] is a locally convex space. We shall show now that s = t. 

Let ¥(t) denote the family of sets defined in part (a) of the con- 
struction process. If W is any t-neighborhood of zero in X then W 


contains a set Ve ¥(t). There is a finite set Vj, ..., V, in ¥° and 
numbers ¢, ..., & such that V = {x in X|P,(x) <«, for 1 <j <n}. 
Now 


(x | Polx) < &} = efx | Pa (x) < 1} = 8)¥ 


so V=()6,V, is in ¥. This proves that t is weaker than s. The fact 
that s is weaker than ¢ is proved similarly. 


The normed spaces are a subfamily of the family of all Hausdorff, 
locally convex spaces. This subfamily was neatly characterized by 
Kolmogorov, and we shall present his characterization now. 


Definition 3. Let X[t] be a locally convex space. A subset B of X is 
said to be a t-bounded set if, for every t-neighborhood U of zero, there 
is a scalar A such that B cCAU. 


Theorem 2. Let X[t] be a locally convex space. There is a norm on 
X such that the norm topology is equivalent to ¢ iff there is a t- 
bounded t-neighborhood of zero in X. 


Proof. Suppose that there is a norm ||-|| on X such that the norm 
topology is equivalent to t. Then, if # is the unit ball of (X, ||-||), #isa 
t-neighborhood of zero. But since t is equivalent to the norm topology 
any t-neighborhood V of zero must contain some multiple of #; ie., 
there is a 4p > O such that V > p#. Clearly then, (1/u)V > Band # isa 
t-bounded set. 

Now suppose that X[t] contains a t-bounded t-neighborhood of 
zero. We may assume that W is balanced, t-closed, and convex. The 
gauge function q of W is a seminorm on X. Suppose that, for some 
x € X, q(x) =0. Then for each positive integer n there is an x, € W 
such that x, = nx. Let p be any ft-continuous seminorm on X, let 
U = {x in X | p(x) < 1}, and choose 4 in K such that W cAU. Then 
p(x) <A for all x in W. Combining these observations we have 


3, LOCALLY CONVEX SPACES. KOLMOGOROV’S THEOREM 69 


p(x) < A/n for every n. It follows that p(x) = 0 and, since t is a Haus- 
dorff, locally convex topology, x = 0. Thus q is anorm on X. We must 
now show that the topology induced on X by q is equivalent to t. This 
is easy. Since W is a t-neighborhood of zero ¢ is stronger than the norm 
topology, but since W is bounded t is weaker than this topology. 


EXERCISES 3 


«1. Let X[t] be a locally convex space and let f be a linear functional 
on X. 

(a) If xo is a fixed point of X show that the map that takes each 
point x of X to x + xo is a homeomorphism in X{t]. 

(b) Show that f is t-continuous on X iff it is t-continuous at 
zero. Show that f is t-continuous at zero iff there is a t- 
neighborhood U of zero such that sup{| f(x)| |x in U} is 
finite. 

(c) Assume that f # 0 and show that the following conditions 
on f are equivalent: 

(i) fis t-continuous on X. 
(ii) The null space of f is a proper, t-closed, linear sub- 
space of X. 
(ili) The null space of fis not t-dense in X. (Hint: See the 
proof of Lemma 1 in Section 1.3.) 

(d) Suppose that (B, ||-||) is a nonreflexive Banach space. 
Using (c) show that there are linear subspaces of B’ that are 
norm closed but o(B’, B)-dense in B’. 

2. Let X[t] be a locally convex space. Show that every t¢- 
neighborhood of zero in X contains an absorbing, balanced, 
convex, t-closed t-neighborhood of zero. 

3. Let X[t] be a locally convex space, let B be a subset of X, and let 
t = t({p,}), where {p,|y in T'} is a family of seminorms on X. 
x(a) Show that B is t-bounded iff sup{p,(x)|x in B} is finite for 

every ). 

(b) If B is r-bounded show that the t-closure of B is t-bounded. 

x(c) If ¢ is a continuous, linear map from X[t] into a locally 
convex space Y[s], show that o(B) is s-bounded in Y when- 
ever B is t-bounded in X. 
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(d) Let (E, ||-||) be a normed space. Refer to the Banach- 
Steinhaus theorem to prove: A subset of E is norm 
bounded iff it is o(E, E’)-bounded (Exercises 3.3, problem 
4). 


4. The Hahn-Banach Theorem. 
Reflexive Banach Spaces 


The topology of any locally convex space can be defined by means 
of a family of seminorms. This makes locally convex spaces convenient 
to work with. But these spaces are convenient for another reason. We 
shall see that an analog of the Hahn-Banach theorem is true for locally 
convex spaces. One consequence of this result will enable us to prove 
that a Banach space whose unit ball is compact for the weak topology 
is necessarily reflexive. The theorem also has other applications and we 
shall explore some of these later. 

Recall that if X is a vector space over K, a real-valued, real linear 
functional on X is a map f from X into R such that f(x + y) =f(x) + 
f(y) for all x, y in X, and f(x) = af (x) for all x in X and all « in R. 


Theorem 1. Let X[t] be a locally convex space, let C be a closed, 
convex subset of X, and let x be any point of X that is not in C. Then 
there is a t-continuous, real-valued, real linear functional fon X such 
that f(xo) > sup{ f(x)|x in C}. 


Proof. There is a family of seminorms {p,} on X such that 
t = t({p,}). Also, there is a t-neighborhood U of zero in X such that 
Xo + U is disjoint from C. We may suppose that there is a finite set p,, 
.++5 Pn in {p,} and positive numbers ¢,, ..., &, such that U = {x in 
X | p(x) < ¢;for 1 <i <n}. Let V = {x in X | p(x) < ¢;/2 for 1 <i < n}, 
let C = (J {x + V|x in C}, and note that C is a t-open set that contains 
C but does not contain x). We shall now show that there is no loss in 
generality in assuming that C is a convex set that has zero in its 
interior. 

Take u, v in C and a real number a with 0 <a <1. Then 
u=X+u,,v = y+ vy, where x, y are in C and u,, v, are in V. Clearly, 


au + (1 — av = fax + (1 — a)y} + fou, + (1 — a), }. 
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Since the first term on the right is in C and the second is in V their sum 
is in C and so C is a convex set. Now let z be any point of the t-open set 
C. Clearly C —z has zero in its interior and if we can find a t- 
continuous, real-valued, real linear functional f on X such that 
f (Xo — z) > sup{f(y)|y in CG —z} then we shall have proved the 
theorem. So we can, and now do, assume that C is a convex set that 
contains zero in its interior. 

Let p be the gauge function of C and note that since C is a neigh- 
borhood of zero, p is real valued (Section 3, Lemma 2). Regard X as a 
vector space over R, define f (Ax,) to be Ap(xo) for all real scalars A, and 
note that f(x) < p(x) for all x in the subspace {Axo |A in R} of X. We 
now refer to part (a) of the proof of the Hahn-Banach theorem (Sec- 
tion 3.2, Theorem 1). It is shown there that we can extend f to a 
real-valued, real linear functional F on X in such a way that F(x) < 
p(x) for all x. Clearly 


F(xo) = p(xo) > 1 = sup{p(x)|x in C} 
> sup{p(x)|x in C} > sup{F(x)|x in C}. 


Hence we shall be finished once we have shown that F is t-continuous 
on X. 

Since F(x) < p(x) on X we must have F(—x) < p(—x) or F(x) > 
—p(—x) for all x in X. Hence for all x in X, — p(—x) < F(x) < p(x). 
Now C contains a balanced, t-neighborhood U of zero (Section 3, 
Lemma 2). Clearly, p(—x) = p(x) for x in U and so p, and hence F, is 
bounded by one on U. It follows that F is t-continuous on X. 


Corollary 1. Let X[t] be a locally convex space, let C be a ba- 
lanced, closed, convex subset of X, and let xo be a point of X that is not 
in C. Then there is a continuous, linear functional h on X such that 
|A(xo)| > sup{ [A(x)| [x in C). 


Proof. Regard X as a vector space over R and use Theorem | to 
find a continuous, real-valued, real linear functional fon X such that 
f (xo) > sup{f (x)|x in C}. There is a number « that is strictly less than 
f (xo) and strictly greater than the supremum. Since C is balanced we 
can assume that a = 1. Define h(x) = f(x) — if (ix) for all x in X. By 
part (b) of the proof of the Hahn-Banach theorem (Section 3.2, 
Theorem 1), hf is a continuous, linear functional on the complex vector 
space X. Also, |h(xo)| = | f (xo)| > 1. Ifx is any element of C we have 


h(x) = pe®, |h(x)| = p = e” A(x) = A(e™ x). 
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But is a real number and so h(e~ ®x) = p means h(e~ x) = f(e7 x). 
Since e~ x is in C because C is balanced and fis bounded by 1 on C, 
p<. 


Let us return now to the study of the weak topology of a normed 
space. Theorem 1 has some interesting implications in this situation. 
We shall continue numbering our results as we did in Section 1. 


(7) A convex subset of a normed space (E, |\-||) is closed for the norm 
topology iff it is closed for the weak topology. 


We need only prove that a convex, norm closed subset of E is 
closed for the weak topology. Let C be such a set and suppose that 
Xo € E is not in C. By Theorem | there is a real-valued, real linear 
aay f on E that is norm continuous and satisfies f(x9) > a > 
sup{ f(x)|x in C}; here « is some real number. At this point we distin- 
guish cases: 


(a) If E is a vector space over R, then fe E’ and so f is 
o(E, E')-continuous on E. But then {x in E| f(x) > a} is a weak neigh- 
borhood of x9 that is disjoint from C. Since xo was any point of E that 
is not in C we conclude that C is o(E, E’)-closed. 

(b) If E is a vector space over C we could reason as we did in (a) 
once we show that fis weakly continuous on E. We eer Ave part (b) 
of the proof of the Hahn-Banach theorem) that h(x) — if (ix) is 
in E’. It follows that h(x) is o(E, E’)-continuous on E. Asal h(x) = 
f(x) + if (ix) is also o(E, E')-continuous on E; it is the composition of 
h(x) and the map that takes each ze C to ze€C. But since f(x) = 
4[h(x) + h(x)] we see that f is o(E, sepa on E, 


(8) In any infinite dimensional normed space ( 
set S = {x in E| |x| = 1} is dense in the on ball pipe the weak 
topology. 


Let 4 be the unit ball of E, 4 = {x|||x|| < 1}, and note that # is 
a(E, E’)-closed by (7). Since S < 4 we need only show that any point 
of E whose norm is less than one is in the weak closure of S. Choose 
. Then V 
contains x) + U, where U is of the form {x in E| | fi(x)| <; for 
1<i<n}. So 


V>{ {y|y €xo + U} 
= {y|y — xo €U} = {y| |fily — x0) | < efor 1 <i<ni. 
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Since E is infinite dimensional we can choose z in (Ve: N(f,), z #0; 
here N(f;) = {x| f(x) = 0}. Note that, for any scalar «, az is in 
(\r-1 N(f,) and so x + az is in V. Since the map a — az is continuous 
from K to E, the map az > az + X is continuous from E to E, and the 
map az + Xo > ||az + xq || is continuous from E to K, it follows that 
a — ||az + Xq || is a continuous map from K to K. We are trying to 
show that S is o(E, E’)-dense in 4. We chose x9, ||xo || < 1, and an 
arbitrary weak neighborhood V of xy. What we must do is show that 
VOS#Q. When «=0,_ jlaz+x9|| = |x0l] <1. Writing 


az = AZ +Xy —Xo we see that |a||z|| — ||xo || < |laz + xo || and so 
az + Xp || tends to infinity as « tends to infinity. By continuity, then, 
there is some number a such that ||a9z+ x9 || = 1, and, since 


9 Z + Xo is always in V, az + Xo is in SO V. This proves (8). 


The unit ball of E” (call it 4”) is weak* closed by Alaoglu’s theorem 
(Theorem 1 of Section 1). Let 4 be the unit ball of E, regard E as a 
subspace of E”, and let cl 4 denote the o(E", E’)-closure of 4. We 
know cl 4 c 4”. Suppose ¢p is in 4” but is not incl 4. Since cl # isa 
balanced, closed, convex subset of E’[o(E”, E’)] there is, by Corollary 
1, a continuous, linear functional f on this space such that | f(@o)| > 
sup{ | f(x)| |x in cl 4}. But, by (4), fe E’. So 


| F(Po)| < | FI loo] < Fl] = supt] FOx)| [x in} 
< sup{| f(x)| |x in cl 4}, 


which is a contradiction. We have proved: 


(9) (H. Goldstine) The unit ball of a normed space (E, ||: ||) is dense in 
the unit ball of E” for the weak* topology. 


Theorem 2. A Banach space is reflexive iff its unit ball is compact 
for the weak topology. 


Proof. We have already proved the necessity of this condition 
(Section 1, Corollary 1 to Theorem 1). Let (B, ||: ||) be a Banach space 
whose unit ball & is coinpact for the weak topology. Since o(B, B’) is 
just the restriction to BoB” of the topology o(B’, B’), #& is 
o(B’, B’)-compact in B’. But by (9) this says that the unit ball of B 
coincides with the unit ball of B’, and hence that B = B’. 


CHAPTER 95 


More about Weak Topologies 


1. Dual Spaces and the Krien—-Milman Theorem 


At the beginning of Chapter 4 we asked whether every Banach 
space is equivalent to a dual space. We are now in a position to answer 
this question. First, let us be more precise about what we mean by a 
“dual space.” We shall say that a Banach space B is a dual space if 
there is a Banach space B, such that B and B’ are equivalent (Section 
3.1, Definition 2). Since a normed space and its completion have the 
same dual (Exercises 3.3, problem 1b), the assumption that B, is a 
Banach space involves no loss in generality. As a matter of fact, the 
assumption that B and B’ are equivalent, rather than just topologically 
isomorphic, also involves no loss in generality (see problem 1). 


Lemma I. If the Banach space (B, ||-||) is a dual space, then there 
is a Hausdorff, locally convex topology t on B, compatible with the 
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vector space structure of B (Section 4.3, Definition |), such that the 
unit ball of (B, ||-!|) is t-compact. 


Proof. By hypothesis there is a Banach space B, and an equiv- 
alence u from B onto Bj. The adjoint of u (Exercises 4.1, problem 4) 
u* is a linear map from Bj onto B’, and so Q = u*(B,) is a linear 
subspace of B’. Each f in Q defines a seminorm on B (recall that 
p(x) = | f(x)| for all x in B). The family of all these seminorms 
defines a locally convex topology on B, compatible with the vector 
space structure of B (Section 4.3, Lemma 1), which we shall denote by 
o(B, Q). We will now show that u is a homeomorphism from 
Blo(B, Q)] onto Bi [o(B), B,)]. 

Since u* is an equivalence (Exercises 4.1, problem 4b), a typical 
a(B, Q)-neighborhood of zero is formed as follows: Take a finite set y,, 
Vo, +++, ¥, in B,, the same number of positive real numbers ¢,, €3,..., 
é,, and let V = {x € B| |u*(y,)x| < 6 for 1 <i <n}. Clearly 


u(V) = {fe B,| f= u(x) for some x € V} 
{fe By| f= u(x) and |u*(y,)x| <¢, for 1<i<n} 
(fe Bi || f(y) | <a for 1 <i<n} 


(see the definition of u*). This last set is a_ typical 
o(B, B,)-neighborhood of zero in Bi. Thus u is a homeomorphism 
between these two spaces (see the discussion in Section 4.3 just after 
Definition 1). In particular, we see that o(B,Q) is a Hausdorff 
topology. 

Now set t = o(B, Q). It follows immediately that, since u maps the 
unit ball of B onto the unit ball of Bi, the unit ball of B is t-compact 
(Section 4.4, Theorem 1). 


lI 


Krein and Milman [17] were the first to prove that the compact 
subsets of a Hausdorff, locally convex space have a useful geometric 
property. Their remarkable theorem will enable us to settle the 
question under discussion here, and this is only one of its many 
applications. 


Definition 1. Let X be a vector space over K, let A be a nonempty 
subset of X, and let B be a subset of A. If the conditions x, yin A, aa 
real number such that 0 <a@ < 1, and ax + (1 — a)y in B imply that 
both x and y are in B, then we shall say that B is an extreme subset of 
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A. An extreme subset of A that consists of a single point will be called 
an extreme point of A. 


For example, if A is the solid unit square in R? (ie. 
A = {(x, y)|O<x <1, 0<y< 1}) then the boundary of A is an ex- 
treme subset of A, and the vertices of the square are extreme points of 
A. If A is the unit disk in the complex plane then each point of the unit 
circle is an extreme point of A. 


Theorem | (Krein-Milman Theorem). Every compact subset of a 
Hausdorff, locally convex space has extreme points. Furthermore, the 
closed, convex hull of the extreme points of any such set is equal to the 
closed, convex hull of the set itself. 


Proof. Let X[t] be a Hausdorff, locally convex space and let A be 
a compact subset of X. Let # be the family of all closed, extreme 
subsets of A and notice that # is not the empty family since it contains 
A. Partially order Y by inclusion, let @ be a chain in this partially 
ordered set, and note that, since A is compact, the set T = (){S|S € @} 
is nonempty. It is easy to see that T is a lower bound for @ and hence 
by Zorn’s lemma ¥ contains a minimal element Ao. 

Suppose that Ay contains two distinct points x,, x,. Choose a 
continuous, real-valued, real linear functional f on X[t] such that 
f (x1) #f(x2) (Section 4.4, Theorem 1), Let A; = {x € Ao | fattains its 
maximum on A, at x}. Clearly A, is a closed, proper subset of Ay. If we 
can show that A, is an extreme subset of A, then we shall have reached 
a contradiction. With this in mind we suppose that x, y are in A, that « 
is a real number such that 0 < « < 1, and that ax + (1 — @)y is in Aj. 
This last condition says that f attains its maximum over Ap at 
ax + (1 — a). But since f is linear this means that f attains its maxi- 
mum over Ao at both x and y; i.e., both x and y are in A,. Thus A has 
extreme points. 

Let B be the set of all extreme points of A, and let c.c.(B), c.c.(A) 
denote the closed, convex hulls of B and A, respectively. To prove that 
these two sets are equal it is sufficient to prove that A is contained in 
c.c.(B). Suppose that the point z € A is not in c.c.(B). We can (Section 
4.4, Theorem 1) find a continuous, real-valued, real linear functional g 
on X[t] such that g(z) > sup{g(x)|x in c.c.(B)}. Let A, = {ye Alg 
attains its maximum on A at y}. Since A, is anonempty compact set, it 
has an extreme point w. But because of the way g was chosen, w could 
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not be an extreme point of A. Thus there are distinct points w,, w, of A 
and a real number a, 0 < a < 1, such that w = aw, + (1 — a)w,. But 
since g is linear and attains its maximum on A at w, it attains this 
maximum at each of the points w,, w,; i.e. both w, and w, are in A). 
This contradicts the fact that w is an extreme point of A,. 


Combining the Krein~Milman theorem with Lemma | we see that 
a Banach space whose unit ball has no extreme points could not be a 
dual space. Such spaces do exist. Consider, for instance, (L,[0, 1], 
||: ||). Given f in this space with | f||, = 1, we can choose a real 
number c such that {6 | f(t)| dt = 2~'. Having done that we define f, 
and f, as follows: f,(t)=2f(t) for O<t<c, fi(t)=0 for c<t; 
fo(t) = 0 for 0 < t <c and f,(t) = 2f(t) for c <t < 1. Clearly f,, f, are 
in the unit ball of L,,f; #f2, and f=27'f, +27 'f,. 


EXERCISES | 


1. Let B be a Banach space and suppose that there is a Banach space 
B, such that B and B;, are topologically isomorphic. Show that 
there is a Banach space B, such that B and BY are equivalent. 


2. Let X be a vector space over K, let A be a balanced subset of X, 
and let x be an extreme point of A. Show that for any oe K, 
|a| = 1, ox is also an extreme point of A. 


3. (a) Show that the extreme points of the unit ball of /,, are the 
points {x,} € 1, such that |x,| = 1 for all n. 

(b) Show that the extreme points of the unit ball of /; are the 
points ge,,n= 1,2,..., where |o| = 1, and e, is the sequence 
with one in the nth place and zeros elsewhere. 

(c) Show that (co, ||-||..) is not a dual space. 


4. (a) Let B be an infinite dimensional Banach space whose unit 
ball has only a finite number of extreme points. Show that B 
is not a dual space. 

(b) Show that a point fin (C[0, 1], ||-||..) is an extreme point of 
the unit ball of this space iff | f(t)| = 1 for all t. 
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(c) Show that the Banach space of real-valued, continuous func- 
tions on [0, 1] is not a dual space. 


2. The Eberlein-Smulian Theorem 


We have seen that the unit ball in the dual of any normed space, is 
weak* compact (Section 4.1, Theorem 1). If the normed space is separ- 
able, then any sequence of points in this ball has a weak* convergent 
subsequence (Exercises 4.1, problem 5). Let us take a look at the dual 
of the nonseparable space (I,,, ||-||,.). For each n define u, € I’, as 
follows: u,({x,) = x, for every {x,} € 1. Clearly u,, u,,u3,... are all 
in the unit ball of I’,,. Let {u,,} be any subsequence of {u,}. We shall 
show that {u,,} is not weak* convergent. All we have to do is to find 
(x;} € 1, for which lim;..,, u,,({x,}) does not exist. Define a sequence as 
follows: If k =n, let x, = 27 '[1 + (—1)]; if k # n; for all j, let x, = 0. 
Then {x,} is in 1, and u,({x,}) = 2° '[1 + (—1)]. Clearly lim u, ({x,}) 
does not exist and we have proved: 


(10) A sequence of points of a weak* compact set need not have a weak* 
convergent subsequence. 


Our result (10) is in striking contrast to the situation in a metric 
space. We know that a subset A of a metric space is compact iff every 
sequence of points of A has a subsequence that converges to a point of 
A, Also, A is compact iff every sequence of points of A has an adherent 
point in A. Now let E be a normed space. Which of the above equiv- 
alences is true for subsets of the topological space E[a(E, E’)}? This 
question will occupy us for the remainder of this chapter. Our first 
theorem, which will take a while to prove, is a generalization ofa result 
of Smulian [see 16, p. 311]. 


Theorem I. Let (E, ||- ||) be a normed space and let A be a subset 
of E that is o(E, E’)-compact. Then every sequence of points of A has a 
subsequence that is o(E, E’)-convergent to a point of A. 


(11) Let (E, ||-||) be a separable, normed space. Then E' contains a 
countable, weak* dense set. 


Let {x,! be a countable, total subset of E (Exercises 4.1, problem 3) 
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such that ||x, || = 1 for all n. Define a metric d on E’ as follows: For 
each pair (f, g)€ E’ x E’ let d( fg) = ink, 2-"|(f — g)(x,)|. Let 4 
be the unit ball of E’ and consider the identity map I from .4’ with the 
topology induced on it by o(E’, E) onto .4’ with the topology induced 
on it by d. We shall show that J is a homeomorphism. 

If fo € 4 then a d-neighborhood of fo is 


{fe B’|d(f fo) <e} = Ire B YF ~ fe) < ‘|. 


Since 4 is norm bounded we can choose m_ so_ that 

ey 2°-"|(f—- g)x,| <e/2 for all f£, g in 4’. Thus I~* of our d- 
neighborhood of f contains the o(£’, E)-neighborhood 
{fe B’||(S—fo)xn| < 22m) 'e for n= 1, 2, ..., m} of fo, ie., I is 
continuous. But since 4’ is o(E’, E)-compact, J is a homeomorphism 
[21, Proposition 5, p. 159]. 

We have just shown that 4’, with the topology induced on it by 
o(E’, E), is a compact metric space. It follows [21, Proposition 13, 
p. 163] that 4’ contains a countable, o(E’, E)-dense set. But 
E’ = | J, n4’ and so E' also contains such a set. 


(12) Let (E, ||-||) be a separable, normed space and let A be any 
a(E, E’)-compact subset of E. Then the topology induced on A by 
o(E, E’) is metrizable. 


Let {f,| be any weak * dense sequence in E’. We can define a metric 
d on E by letting d(x, y) = )'?_, 2>"| f,(x — y)| for all x, y in E. Since, 
by the Banach-Steinhaus theorem, A is bounded, the argument used to 
prove (11) shows that the topology induced on A by a(E, E’) coincides 
with the topology induced on A by d. 


(13) Let (E, |||) be a normed space and let H be a closed, linear 
subspace of E. Then the dual of H is equivalent to E'/H. 


Recall that H+ = {f € E’| f vanishes on H}. The quotient norm was 
defined in Section 2.4, Definition 1. For fe H’ consider the set 
F = {ge E'| f=g on H}. We can identify this set with an element of 
E’/H*, which we shall call @(f). Thus we have a map ¢ from H’ onto 
E’/H*, and clearly ¢ is an isomorphism. Now ||@(f)|| = inf{|/g|| |g € F} 
and so ||@(f)]| > || ||. But, by the Hahn-Banach theorem, there is a 
g € F such that ||g'| = || |. Hence | (f)|| = ||f|| for all fe H’. 

This result has an immediate corollary: 


(14) Let (E, | 


‘||) be a normed space and let H be a closed, linear 
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subspace of E. Then the restriction to H of the topology a(E, E') 
coincides with the topology o(H, H’). 


We can now prove Theorem 1. Let {a,} be any sequence of points of 
A and let H be the closed, linear subspace of E generated by {a,'. H is 
a(E, E’)-closed (Section 4.1, (3)) and so H 1 A is o(H, H’)-compact in 
H (we are using (14)). But H is separable, so, by (12), {a,} has a 
o(E, E’)}-convergent subsequence. 


W. F. Eberlein [5] was the first to show that if (B, ||-||) is a Banach 
space, a subset A of B is o(B, B’)-compact iff every sequence of points 
of A has a a(B, B’)-adherent point in A. We shall present his proof 
below. The following result, which is true only for Banach spaces (see 
(16)), plays a crucial role in this proof. 


(15) Let (B, ||: ||) be a Banach space. A norm closed, hyperplane in B’ is 
weak* closed iff its intersection with the unit ball of B’ is weak* 
closed. 


Recall that a hyperplane in B’ is a linear subspace that has co- 
dimension one in B’. The necessity of our condition is obvious. Let H be 
a norm closed hyperplane in B’, let 2’ be the unit ball of BY, and let 
cl(H m 4’) denote the weak* closure of H ~ 4’. We want to show 
that cl(H > 2’) = H m &’ implies H is weak* closed in B’. The proof 
will be given in stages: 

(a) H is either weak* closed or weak* dense in B’. 

We know that H is the null space of some element ¢ € B” (Exer- 
cises 1.3, problem 4, and Section 1.3, Lemma 1). If @ ¢ B, then H is 
weak* dense in B’ (Exercises 4.3, problem Ic). 

(b) If H is weak* dense in B’, then B® H* is norm closed in B”. 
Consequently, there is an « > Osuch that a||x|| < ||x + y|| for all x € B, 
all y € H?. 

Let @ be an element of B” whose null space is H. Then H* = {Ap|A 
in K} and clearly B ~ H+ = {0}. Let {z,} be a sequence of points of 
B@H‘' that is norm convergent to z) € B”. Since B is a Banach space 
it is closed in B” and so there is a continuous, linear functional y on B” 
such that W(@) #0, w(x) =0 for all x e B (by the Hahn-Banach 
theorem ). Now for each n, z, = x, + A, where x, € B,4, € K. Apply- 
ing w to {x,+4,} we see that both {x,} and {4,\ converge to, say, 
Xo € B, Ay € K. Clearly 2) = Xo + Ag @. 

The second statement follows from the first and Section 2.5, Corol- 
lary | to Theorem 1. 
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We shall say that cl(H > :4’) contains a ball iff there is an e > 0 
such that {fe B’||| f | < e} ccl(H mF’). 

(c) If cl(H m 4’) does not contain a ball then, for any « > 0, there 
is an x, in B such that sup{| f(x,)| | fin H 7 4} <ellx, |. 

Suppose that this is false. Then for some 6>0 we have 
sup{| f(x)| | fe H a 4} > d||x|| for all x € B. Now the ball 4; is not 
contained in cl(H - 4’) by hypothesis. Thus there is a point fo € 45 
that is not in cl(H 1 .4’). Since this weak* closure is balanced and 
convex, there is a point x 9¢€B such that xo(fo)> 
sup{ | f(xo)| | fe Ho A} > d])xo ||. Thus 


||xo | || fo || = Xo(fo) > 4]|Xo |] 


implies || fo || > 6, a contradiction. 

(d) H is weak* dense in B’ iff cl(H ~ 4’) contains a ball. If 
cl(H ~ 4’) contains a ball then, since the weak * closure of H contains 
Le, ncl(H 7 #’), H is weak* dense in B’. 

Assume that H is weak* dense in B’. We want to prove that 
cl(H - 4’) contains a ball. Suppose that it does not. Then, for any 
e > 0, we can find x, in B such that sup{| f(x,)| | fin Hm 2’} <ellx, | 
by (c). Regard x, as a linear functional on H and extend it, without 
changing its norm, to a linear functional x* on B’. Clearly x* = x, + y, 
y € H'. Also, 


l|x*|| = sup{ |x*(f)| | fe 43 = sup{|x.(f)| | fe Ho 4) <ellx.| 


because the norm of x* is equal to the norm of x, on H. So |x, + y|| < 
é||x, ||. Now by (b) we have «|x, |] < |x, + yl], hence a||x, || < ellx, |]. 
Since ¢ > 0 is arbitrary, this last inequality is impossible. 

Finally, if H ~ 4 is weak* closed then, since H is a proper sub- 
space of B’, H ~ &’ could not contain a ball. It follows from (d) and (a) 
that H is weak* closed in B’. 


(16) A normed space (E, ||-||) is a@ Banach space iff any norm closed, 
hyperplane in E' whose intersection with the unit ball of E’ is 
weak* closed, is weak* closed. 


To prove (16) we need only show that in the dual of any incomplete 
normed space there is a norm closed, weak* dense hyperplane whose 
intersection with the unit ball is weak* closed. Let (E, ||-||) be an 
incomplete normed space and let (E, - |) be its completion (Exercises 


3.4, problem 1a). We know that E and E have the same dual space E’ 
(Exercises 3.4, problem 1b). Let x € E, x ¢ E and regard x as a linear 
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functional on E’. x is not o(E’, E)-continuous on E’ (Section 4.1, (4)). 
So the null space of x, N(x), is o(E’, E)-dense in E’ (Exercises 4.3, 
problem Ic). But, if #’ is the unit ball of E’, the set N(x) n B is 
o(E’, E)-compact. Thus the Hausdorff topology o(£’, E) must coincide 
with o(E’, E) on this set [21, Proposition 5, p. 159]. Hence N(x) AB’ 
is o(E’, E)-closed. 


Remark 1. In the dual of a Banach space the following is true: A 
norm closed, linear subspace is weak* closed iff its intersection with 
the unit ball is weak* closed. I believe that this was first proved by S. 
Banach. A proof can be found in [16, (6), p. 273]. 


Theorem 2 (W. F. Eberlein). Let (B, ||-||) be a Banach space. For 
any weakly closed subset A of B the two following conditions are 
equivalent: (a) A is o(B, B’)-compact. (b) Every sequence of points of A 
has a o(B, B’)-adherent point in A. 


Proof. Assume (b) and notice that, by the Banach-Steinhaus 
theorem, this implies A is norm bounded. Thus, by Alaoglu’s theorem, 
the closure of A in B"[o(B’, B’)] is o(B’, B’)-compact. Hence to prove 
that (b) implies (a) it suffices to show that this closure is contained in B. 
Let @ be an element of B” that is in the o(B”, B’)-closure of A. The null 
space of @, N(), is a norm closed hyperplane in ms By (15), @ will be in 
B iff N(@) ~ 4’, where 4’ is the unit ball of B’, is weak* closed. 

To prove that N(d) ~ &’ is weak* closed we need only show that if 
g € B’ is in the o(B’, B)-closure of this set, then o(g) = 0. Let g € B’ be 
in this closure and notice that we can find xo € A such that g(xo) = 
$(g) because {y € B’| |W(g) — (g)| < 1/n} contains x, € A for n= 1, 
2,..., and we can take x9 to be any o(B, B’)-adherent point of {x,} that 
is in A. Given ¢ > 0, {fe B’| |g(xo) Sea < ¢/2} contains a point 
fi © N(o) a &. By the argument just given we can find x, € A such 
that (9) = glx: (fr) = ales). Now {fe B’| |g(x:)—S(x)| <6/2 
for i = 0, 1} contains f, € N(d) 7 4’. So now we choose x, € A such 
that $(g) = g(x2), O(/1) = filx2), O(f2) = fo(%2). Continue in this way. 
After Xo, Xy, .--, x, and fy, fo, ..., f, have been chosen, choose 
Sas © N(@) 0 #, which is in (f € B’| |g(x;) —f(x1)| < ¢/2 for i= 0, 
1, 2, ..., ki, and then choose x,,,€ A such that $(g) = g(x,+1), 
O(F;) =FAXu41) for j= 1, 2,..., k + 1. In this way we generate two 
sequences {x,}% 9 CA, {fyi <N(p)- 4’, which satisfy: (i) 
SnlX,) = 9 for m<n (because f,(x,)= (f,) =0 for m<n); (ii) 
9(Xn) = P(g) for all n; (iti) |O(g) — fa(Xn) | < €/2 for n<m. 
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Now we are assuming condition (b) and so {x,'! cA has a 
o(B, B’)-adherent point y € A. So for any 6 > 0 and any integer M, 
{x € B| | f(x) —finly)| <6 for m= 1, 2, ..., M} contains infinitely 
many points of the sequence {x,}. It follows, from (i), that | f,(y)| <6 
for m= 1, 2, ..., M, and this implies f,,(y) = 0 for all m. The point y is 
in the o(B, B’)-closure of {x,} and so (Section 4.4, (7)) it is in the norm 
closure of the convex hull of {x,' (for the definition of convex hull see 
Exercises 4.2, problem 1b). So there is a z in this convex hull such that 
|y — z|| <«/2. We must have z = )?_, a,x, (Exercises 4.2, problem 
1b), where a, > 0 for all n and }?_, a, = 1. Set m= P + | and con- 
sider inequality (iii). We have |(g)—f,(x,)| <¢/2 for n<m= 
P+ 1, and so 


1b(9) — fp+i(%0)| < 6/2, |@(9) — fps 1(%1)| < €/2, 
sy |O(9) — fo+1(Xp)| < ¢/2. 


If we multiply each of these inequalities by the appropriate a, and add 
we get |b(g) — fp+i(z)| < ¢/2. But 


| $(9)| < | O(g) — fps 1(2)| + | fe+s(z) 


— fossly)| <£/2 + |fe+1| lz —yll <e 


since each f, € 4’. Now since « > 0 was arbitrary @(g) must be zero 
and the proof is complete. 


Combining Theorems | and 2 we obtain a result that is often called 
the Eberlein—Smulian theorem. 


Theorem 3. Let (B, ||-||) be a Banach space. For any weakly 
closed subset A of B the three following conditions are equivalent: 


(a) A is o(B, B’)-compact. 

(b) Every sequence of points of A has a subsequence that is 
o(B, B’)-convergent to a point of A. 
(c) Every sequence of points of A has an adherent point in A. 


Remark 2. Referring to Theorem 3, a set with property (a) is 
called a weakly compact set. A set with property (b) is called a sequen- 
tially weakly compact set, and one with property (c) is called a 
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countably weakly compact set. For another proof of the Eberlein— 
Smulian theorem see [26]. 


EXERCISES 2 


1. (a) Let T be a compact space. Show that any sequence of points 
of T has an adherent point in T. 

(b) Let S be a topological space. Show that the two following 
conditions on S$ are equivalent: (i) Every sequence of points 
of S has an adherent point in S. (ii) Every countable open 
covering of S has a finite subcovering. 

2. Let J be an uncountable set. For each v € I let C,, = [0, 1] and, in 
the compact set [ ]{C,.|v € 1}, consider G = {{x,}|x, = O except for 
countably many v € I}. Show that G is not compact and yet every 
sequence of points of G has a subsequence which converges to a 
point of G. 

3. Let (E, ||||) be a normed space and let H be a closed, linear sub- 
space of E. Show that the dual of E/H (Section 2.4, Definition 1) is 
equivalent to H+. 

4. Show that a Banach space is reflexive iff each of its closed, linear, 
separable subspaces is reflexive. 


CHAPTER 6 


Applications to Analysis 


1. Applications to Trigonometric Series 


The theory of normed spaces has some nice applications to the 
study of Fourier series. In order to present these we shall have to recall 
some of the properties of the L,-spaces of real variable theory. A 
detailed treatment of these spaces can be found in either [10] or [21]. 

One can define an equivalence relation on the set of all complex- 
valued, measurable functions on [—z, 7] by calling two such functions 
equal if they differ only on a set of measure zero. The equivalence 
classes are, by convention, also called functions and these are the 
elements of our L,spaces. For real p, p21, let 
L,={f| 9 |£(x)|P dx < co}, where we agree that, throughout this 
chapter, any integral without limits goes from —n to x. If f is in L, we 
define || f ||, to be the pth root of | | f(x)|? dx. Each of the spaces 
(L,, ||-||,) is a Banach space. 
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If p> 1, then the dual of (L,, ||-|],) can be identified with the space 
(L,, ||‘l|,), where p-' + q”*' = 1. This means that if G is any contin- 
uous, linear functional on L,, then there is a unique element g in L, 
such that |/G|| = |ig||, and G(f)=J f(x)g(x) dx for all fin L,. The 
dual of (Ly, ||-||,) can be identified with the space (L,,, ||-||..), where 
L,, is the space of all essentially bounded functions and, for fin L,,, 
| f ||. is the essential supremum of f. In this connection we also recall 
the Holder inequality: If f and g are in L, and L,, respectively, where 
p'+q°'=1, then || fal: <|If\lp lla: 

It is convenient to identify each fin L, with its extension, by 2z- 
periodicity, to all of R; ie., for any x € R, f(x) = f(y), where y is the 
unique element of (— 2x, x} such that x — y is an integral multiple of 27. 
With this convention, for any p, any f in L,, and any ¢ in R, we can 
define f(x) to be f(x — t) and have f, € L,, ||f: |, = || f llp- Also, there 
follows: 


Lemma 1. Let feL,, p finite. Then for any s in R, 
lim,., |. —Jf, || = 0. 


Proof. For any € > 0 we can choose a continuous function g such 
that | f— gl, <«¢/4. Then 


|fi—Selle Se Gly + lide Gs lle + los — Lolly S £/2 + le — Isllp- 


Since g is continuous this last term can be made as small as we please 
by choosing |f — s| sufficiently small. 


Definition 1. Let fe L,. The numbers 
F(n) = (1/2) | f(xje"™ dx, n= 0, +1, $2... 


are called the Fourier coefficients of f. The function f, defined on the 
integers, is called the Fourier transform of f. 


Notice that, since [—z, 7] has finite measure, we have defined the 
Fourier coefficients, and the Fourier transform, of any L,-function. We 
record here, for later use, the following: 


Theorem 1 (Riemann-Lebesgue). If fe L,, then 
lim, + + « f(n) = 0. 


Proof. By definition, f (n) = (1/2) J f(x)e7™* dx and, because of 
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our conventions, —f(n) = (1/2) J f(x) exp{—in(x — n/n)} dx. Hence 
2f(n) = (1/2n) fe ™{f (x) — f(x + x/n)} dx and so 


2| f(n)| < (1/27) | f —f— nin l|1- 


This last term tends to zero, as n > +00, by lemma |. 


The following problem is of interest to harmonic analysts. Given a 
sequence {c,|n =0, +1, +2,...}, find necessary and sufficient condi- 
tions for {c,} to be the Fourier transform of a function in L,; i.e., we 
want necessary and sufficient conditions for the existence of a function 
f, fin L, for some p, such that f(n) = c, for all n. 

It is clear that the partial sums of the series )* _ ,, c, e" are in L, 
for every p. If these partial sums converge for the norm of some L, 
space, then the limit is a function in L, whose Fourier transform is {c,}. 
Thus the convergence for some L,-norm of our series is a sufficient 


condition for {c,} to be the Fourier transform of an L,-function. 
However, as we shall soon see, we can do much better than this. 

At this point we have to recall a familiar topic from the theory of 
infinite series. If ap , ay, ay,... is any sequence of complex numbers, the 


Cesaro means of this sequence are the numbers 


ag + ay Ag + ay + Az 

Go; = 40, ie awa 63> 3 
If ay, ¢,, 03, ... converges to, say, o, then we say that the sequence ay, 
@,, a), ... is Cesaro convergent to a. A convergent sequence is Cesaro 


convergent to its (ordinary) limit, but there are divergent sequences 
that are Cesaro convergent; 1, 0, 1, 0, 1, 0, ..., for example, is Cesaro 
convergent to 1/2. Now consider a series )'7- - , a,. For each n = 0, 1, 
2,... lets, = )", a,. If this sequence {s,} is Cesaro convergent to, say, 
s’, then we say that the given series is Cesaro convergent to s’. 

Recall that we assumed a sequence {c,} was given and we asked for 
necessary and sufficient conditions for this sequence to be the Fourier 
transform of an L,-function. We can give such conditions in terms of 
the Cesaro means of the series ye _~» C,e™ and here, at last, is where 
we use some functional analysis. Let ,(x) be the nth Cesaro mean of 
this series. Then, if n> |m|, the mth Fourier coefficient of o,(x) is 
[(n — |m|)/n]c,,. Hence lim,..,,(1/2z) J o,(x)e~" dx = c,, for every 
m. Now suppose that for some p > | the sequence {a,(x)} is bounded 
for the L,-norm; i.e., suppose that for some p > 1, supi||o,(x)||, |" = 
0, 1, 2,...} < oo. Since p> 1, L, is the dual of the Banach space La, 
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where p-'! + q~' = 1. But then, by Alaoglu’s theorem (Section 4.1, 
Theorem 1), the sequence {a,(x)} has a o(L,, L,)-adherent point; ic. 
there is an heL, such that for any geL,, and any ¢>0, 
| § [o,(x)o(x) — h(x)g(x)] dx | < ¢ for infinitely many n. Now e”* is in 
L, and so, combining our observations, h(m) = c,, for all m. Hence we 
have proved: 


Theorem 2. If, for some p > 1, the Cesaro means of Y'*. _ ,, c,e"™™ 


are bounded for the L,-norm, then the sequence {c,} is the Fourier 
transform of a function in this space. 


Since L, is not a dual space (Section 5.1, last paragraph) the proof 
given above cannot be used for this space. What we do here is simply 
assume that the Cesaro means converge. 


Theorem 3. If the Cesaro means of the series 17 _ ,, c,e'"* con- 
verge for the L,-norm, then the sequence {c,} is the Fourier transform 
of a function in this space. 


We shall talk about the converses of these theorems later on. Right 
now we want to investigate the following question: If the Fourier 
transform f of an L,-function f is known, can we obtain f and, if so, 
how? The series Y%._,, f(n)e™ and its Cesaro means suggest 
themselves. 


Definition 2. If f L,, then the series )'*. _ ,, f(n)e'"* is called the 
Fourier series for / 


We shall need a convenient expression for the Cesaro means of a 
Fourier series. The nth partial sum of the Fourier series for f (call it 


SalX; f )) is 
E Pye =F et [cam | roy ™ as 


= (1/2n) | f(y) b cao] dy. 


Hence, if K,(x — y) denotes the nth Cesaro mean of the series 
ye, ee", then the nth Cesaro mean of the Fourier series for f (we 
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shall denote it by a,(x; f) is 
(*) oW(xsf) = (1/2) | f(y)Kyx — y) dy. 


Lemma 2. Let K,(x) be the nth Cesaro mean of the series 
y@,, e**. Then for n= 1, 2, 3, ... we have: 


1 — cos nx 1 /sin 4nx \? 
1 — cos x n\ sin 4x 


(i) Kx) =4{ 


n 


(ii) K,(x) > 0 for all x; 
(iii) (1/2n) K,(x) dx = 1. 


Furthermore, if J is any open interval containing zero, then 
lim,.... sup{K,(x)|x € (—2, a], x él =0. 


Proof. Observe that 
(n+ 1)K,. (x) — nK,(x) = ¥ e™ + Yeo. 
0 I 


These last two series are geometric and their sums are 


1 — ellnt tx 1 — ev int Dx 
—-—, -- and -———— + I, 
1 — e™* l-—e 
respectively. Adding these we obtain the formula 


(iiri@aKoe- Sa! 


1 — cos x 
Now K,(x) = 1 so, using our formula, we can find K ,(x). Then, know- 
ing K(x), we can use our formula again to get K3(x), and so on. This 
proves (i) and (ii) follows immediately from (i). To prove (iii) we note 
that if fis identically equal to | then the same is true of each Cesaro 
mean of the Fourier series for f Hence, by (*), l= 
(1/2) | K,(x — y) dy. Setting x = 0 and noting that, from (i), each 
K,(x) is an even function, we have (iii). 

Finally, if O<d<x and 5<|x|<z, then [sin(1/2x)]? > 
[sin(1/25)]*. So, if J is an open interval containing zero and if 6 > 0 is 
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so small that (—6, 6) < J, then 
sup{K,(x)|x € (—z, 2], x ¢ I} < sup{K,(x)|5 < |x| <7} 
< [sin(1/26)]~ 2/n. 


Clearly the limit, as n tends to infinity, of the last of these is zero. 


Theorem 4. If a function lies in L,, 1 < p < oo, then the Cesaro 
means of its Fourier series converge to this function for the L,-norm. If 
the function lies in L,,, then the Cesaro means of its Fourier series 
converge to this function for the weak* topology. 


Proof. Let fe L,, p finite. We want to estimate ||o, —f||,, where 
a, is the nth Cesaro mean of the Fourier series for f. Since L, is the dual 
of L,, by the first corollary to the Hahn-Banach theorem (Section 3.2, 
Theorem 1) we can choose g € L, such that ||g||, = 1 and ||o, —f ||, = 


§ [o,(x) — f(x)lg(x) dx. Now 


| [ Con(x) — F(a) dx 


=| am) fr — 9 


—S(x)]K,(t) dt}g(x) dx 


by (*) and (iii) of Lemma 2. 
This last integral is 


< (42m) [| | L711) as 


which is, by the Hilder inequality, < (1/2z) { |, —S||,K,(t) dt. So 


K,(t) dt, 


lon Sp < (12m) | Ife — Spl Kult) at 


and, if 6 > 0 is fixed, 


lon—Fllp <(1/2n) [+ (1/2R) | 


7 |t{ 26 
<= sup If =f lp ty 2|| f\|psup K,(?). 
-8<t<d |t}>6 
The first of these can be made small by choosing 6 sufficiently small 
(Lemma 1). Once 6 is chosen the second term can be made small by 
choosing n sufficiently large (Lemma 2). This proves the theorem for 
finite p. 
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Now suppose that fe L,,. For any function g € L, we have: 


I [on(x) — f (x)]gs) ax 


+ 2I| flo Sup K,(1). 


|th26 


< sup 


—d<t<d 


(1/2x) | [£( — 1) —f(x)a(s) dx 


To prove the theorem it suffices to show that the first term on the right 
can be made arbitrarily small by choosing 6 sufficiently small. But 
clearly 


[[ 6 -9- Fol 4 


=| | rola) - 0 = wy Iflalla— oils 


and the result follows from lemma 1. 


Theorem 5. A sequence {c,} is the Fourier transform of a function 
in L,, p> 1, iff the Cesaro means of the series ¥’ c, e* are uniformly 
bounded for the L,-norm. The given sequence is the Fourier transform 
of a function in L, iff the Cesaro means of the series converge for the 
L,-norm. 


Proof. For p= 1 the theorem follows from Theorems 2 and 3. For 
| < p< o, it follows from Theorems | and 3. The only thing left to 
prove is that if fe L,,, then the Cesaro means of its Fourier series are 
uniformly bounded for the L,,-norm. But this follows from Theorem 3 
and the Banach-Steinhaus theorem (Section 3.3, Theorem 1). 


Remark. The first person to investigate the Cesaro summability of 


Fourier series was Fejer [13, 6, p. 8]. The sequence of functions {K,(x)} 
is called Fejer’s kernel. 


EXERCISES | 


L. as ae the space L, has an inner product: <f,g>= 
§ f(x)g(x) dx for all fg in L,. Clearly <,» is linear in the first 
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element, <f, g) = <g.f>. and <f f> = ||f |} for all fg in L,. A 
subset H of L, is called an orthonormal set if < f/f > = | for each 
feHand (f,g>=O0forfigin H,f#g. 

(a) Show that any orthonormal set in L, is countable. 

(b) If {f,} is any orthonormal sequence in L, and f € L,, show 
that VY, |<£F>/? < |S ||3 (Bessel’s inequality). (Hint: 
Consider the inner product of f— Y™_, (fff, with itself.) 

(c) Show that for any orthonormal sequence {f,} in L, the fol- 
lowing are equivalent: 

(i) <ff,> = 0 for all n implies f = 0. 

(ii) Foreachfin L,, f= Y, <f£S,>f,, convergence is for 
the L,-norm. 

(iii) For each fin L5, || fi} = Y%1 |<f4,>)° (Parseval’s 
identity). —— 

(iv) For any fg in Lj, <f.g> = V1 KF I<G Sn > (also 
called Parseval’s identity). 

(v) The linear span of {f,} is dense in L, for the norm 
topology. 

(d) An orthonormal sequence in L, that has any of the above 
five properties is called a complete orthonormal sequence. 
(i) Show that {(1/2z)!/e**|k =0, +1, +2, ...} is a com- 

plete orthonormal sequence in L,. 
(ii) Show that the Fourier series of any L,-function con- 
verges to that function for the L,-norm. 

Let f be a continuous function on R such that f(x + 2x) = f(x) for 

all x. Let o,(x) by the nth Cesaro mean of the Fourier series for f. 

Then we have: 

Jou) —F()] < (1/2m) | 


Sx = 1) ~ FO) K (1) at 


= (1/2n) 5 + (1/2n) | 


“|tl>6 


(a) Show that 
[o,(x) —f(x)| <supt [f(x —)-f()|| —9 <1 <9} 
+ 2 max{| f(x)||—-z<x <n} 
sup(K,(0)| |¢| = 3} 


(b) Use (a) to conclude that the Cesaro means of the Fourier 
series for f converge to f uniformly over (—z, 7]. 
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(c) Use (b) to conclude that the polynomials are dense in 


(C[0, 1], ||) 0). 


2. Miscellaneous Applications 


We are going to present two applications of the Banach--Steinhaus 
theorem. The first of these is to a problem in the theory of divergent 
series, Observe that the product 


100 0 0 Ao 
4+ 4000 a 
See way 
+4440 
gives us the Cesaro means of the sequence dao, a,,.... So the given 


sequence is Cesaro convergent iff the sequence obtained by multiplying 
it on the right by the matrix given above is convergent. From this point 
of view Cesaro convergence is a special case of the following: Let A be 
a doubly infinite matrix, ie, A = (a,;), where 1 <i< ao, 1l<j<o. 
Given x = (x,, x2,...), define A(x) = V1 ayx,, i= 1, 2,.... We 
shall say that x = {x,} is A-convergent to the number b if A,(x) exists 
for i= 1, 2,... and lim,.,, A(x) = 6. 

The problem we want to solve is this: Which doubly infinite 
matrices A have the property that every convergent sequence is A- 
convergent to its (ordinary) limit? A matrix that has this property will 
be called a regular matrix. 


Lemma 1. Let (B, ||-||) be a Banach space and let {f,} be a se- 
quence in B’. There isan f € B’ such that lim f,(x) = f(x) for all x € Biff 
{f,} is a norm bounded set and lim f,(y) = f(y) for all y in some total 
subset of B. 


Proof. If there is an fe B’ such that lim f,(x) = f(x) for all x in B, 
then, since B is a Banach space, {f,} is norm bounded (Section 3.3, 
Theorem 1). 

Assume that {f,} and f satisfy our two conditions. Then clearly 


lim f,(z) = f(z) for all z in the linear span of our total subset. Given 
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x eB and «> 0 choose z in this linear span such that |x — z|| <« 
(Exercises 4.1, problem 3). Then 


Le) — fx)] < Is — 2h + LF) — 4) + Als — =I 
<2Me+ |f(2)~ fl), 


where M is a constant that is greater than || f'|\| and || f, || for all n. The 
last term can be made as small as we please by taking n sufficiently 
large. 


Theorem | (Silverman-Toeplitz). The matrix A = (a,,) is a regu- 
lar matrix iff: 


(i) There is a number M such that )@, |a,| <M for i= 1, 
(ii) lim, a;; = 0 for j = 1, 2, .... 
(ii) lim... Y=, a= 1. 


Proof. Clearly c, the vector space of all convergent sequences, is a 
closed, linear subspace of (I,,, ||*||..). Hence (c, ||-||..) is a Banach 
space. Observe that for each {x,} €c, |lim x, | < ||{x,}]].- So the 
linear functional @ on c, defined by @({x,}) = lim x,, is continuous on 
(c, ||-\].0)- Let eo = (1, 1, 1, ...) and, for each n, let e, = (0,0, ...,0, 1,0, 
0, ...) where the | is in the nth place. Clearly each e,,n = 0, 1, ..., isin 
cand @(e9) = 1, 6(e,) = 0 for n= 1, 2,.... 

Assume that A has properties (i), (ii), and (iii). Using (i) we can 
write 


[Aite)| < ¥ lal [xs] <Mteile Y lal <M Ux 


for any x = {x} € c. So each A; € c’ and ||A;|| < M fori = 1,2, ....We 
want to prove that lim A,(x) = @(x) for each x € c. To do that it 
suffices, by Lemma 1, to show that this holds on a total subset of c. 
Clearly eo, ey, ... is such a set. Also, for j = 1, 2, ..., lim;.. Ai(e;) = 
lim,.... 4; = 0 (by (ii)) = @(e,), and 


lim; A,(eo) = lim, ‘ a3; = 1 
j=l 
(by (iii)) = @(e). So if A has properties (i), (ii), and (iii), then it is a 
regular matrix. 
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Now suppose that A is a regular matrix. Then every convergent 
sequence is A-convergent to its (ordinary) limit. In particular, e, 
€,,... are each A-convergent to their limits. This says that conditions 
(ii) and (iii) are necessary. We will now show that (i) is necessary. 
Recall that A,({x;}) = )}2, a,;x,; and, since A is regular, A; is a linear 
functional on c. Fix i and, for each n, let A(x) = )"-, a;;x;- Clearly 
AM ec’ for n= 1, 2,..., and lim,.,, A(x) = A,(x) for every x € c. 
We conclude that each 4; is in c’. 

Now since A is a regular matrix lim;_,,, A,(x) exists for every x € c. 
Hence, by the Banach-Steinhaus theorem, there is a number M such 
that ||A; || < M for all i. Choose an integer N and, for j = 1, 2,...,N 
define x; = G;;|a,;|~' if a,,; # 0, x; = 0 ifa;, = 0. Then set x; = 0 for all 
j>N. Clearly, x = {x;} is inc, |x]. < i, and A({x)= ))-, |a,;| < 
||A; || <M. Since N is arbitrary we are done. 


In 1876 du Bois-Reymond surprised the mathematical community 
by constructing a continuous function whose Fourier series diverges at 
a single point [13, Part I, 4, p. 7]. We are going to use the Banach- 
Steinhaus theorem to prove the existence of such functions. Incidently, 
continuous functions whose Fourier series diverge on a dense set 
(having measure zero) have been constructed [13, Part II, 11, p. 20]. 
However, to my knowledge, the problem of finding a continuous func- 
tion whose Fourier series diverges on a set of positive measure, or 
proving that such functions do not exist, remains open. 

Let C(—2, 2] be the space of all continuous functions on R such 
that f(x) = f(x + 27) for all x. We shall give this space the sup norm 
= sup{| f(x)| |x € R}), and we note that (C(—z, x], ||-|\..) 
is a Banach space. For any fin this space write the Fourier series of fin 
the form $a) + )%-1 (a, cos kx + b, sin kx), where 


ao = (1/n) J f(x) dx, 
= (I/n) § f(x) cos kx dx, and b, = (1/n) { f(x) sin kx dx, k = 1, 
2, .... We want to derive an expression for the nth partial sum of this 
series. To do this we first note that the geometric series 


eilnt 1)x 1 


e* — | 
and so 


Pa! aces 10 e* ac. ff 


+e 2(e* — 1) 
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Multiply the numerator and the denominator of the right-hand 
side of this expression by e~ */? and then equate the real parts of both 
sides to obtain 


co, sin 3(2n + 1)x 
go 2, SRE 
Now let s,(x) be the nth partial sum of the Fourier series for f/ Then 


1 n 
sy(X) = 540 + 2 (a cos kx + b, sin kx) 


- | f(y) dy + : py | f(y)[cos ky cos kx 


+ sin ky sin kx] dy 


1; 1 2 
=~ | FO), + Y cos ky — x)] dy 
q- k=1 
Lo sin $(2n + 1)(y — x) 
= - ye a IS dy, 
2n | f) sin $(y — x) : 
So, letting 
sin $(2n + l)y 
D,(y) = 5 a Be RED a 
we have 


alo) = 5 | FOB, = x) dx 


The sequence {D,(y)} is called Dirichlet’s kernel. 

For each n the map that takes each f € C(—z, 2] to the nth partial 
sum of its Fourier series evaluated at zero (ie. f—> s,(0)) is a linear 
functional on this space, which we shall denote by u,. Clearly, 


uf) = (1/2n) J f(y)DQ) ay. 


Lemma 2. Each of the functionals u,, n= 0, 1, 2, ..., is contin- 
uous on (C(—z, 1], ||-||,,). Furthermore, for each n, the norm of u, is 
the number |, = (1/2n) J |D,(y)| dy. 


Proof. Fix n and let « > 0 be given. All we have to do is construct 
a function f € C(—x, nm] such that || f||,, < land |u,(f)| > 1,-«. 
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Let sgn(0) = 0 and, for real x # 0, let sgn(x) = x|x|~ '. Note that 
sin $(2n + 1)y =0 at the points y = 2/n/(2n + 1), 1/=0, +1, +2,.... 
For 6 > 0, 6 < x/(2n + 1), define f,(y) = sgn(D,(y)) for 

2in : 2(1 + 1)x 


ae O0<y< 
ony adi 2n+ 1 


=, 
and define it to be linear for 
2n+ 1 ge 2n+ 1 


Clearly | f;||. = 1. Also, since |D,(y)| = (1+ 2 Y%_, cos ky| < 
2n + 1, we see that 


+06. 


2n+1 


1 
|un(fs)| > bn — ae Sy potegert of |D,(y)| from 


1=0 


ee ee | 
2n+1 ntl 


5 2nt+1 


~ bent = 2 Qn+ 1)(2n + 2) 


>l,—6& 


for 6 sufficiently small. 
This proves the lemma. 


Suppose that the Fourier series of every function in C(—z, x] is 
convergent at zero; i.e. suppose that lim,..,, u,,(f) exists for every fin 
our space. Then, by the Banach-Steinhaus theorem, there is a number 
M such that J, = ||u, || <M for all n. Thus to prove that there is a 
continuous function whose Fourier series diverges at zero we need 
only prove that lim,.. |, = 0. 

In the interval 


4n+2° 4n+2 
we have |sin 3(2n + 1)y| > fies Hence 


ps? 5 


(¢ +I)n (41+ #] 


(41+ I )re (41 + 3)n| 
integral of in 2 to dn 42 f 


l -1 
sin from 
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For y > 0, sin $y < 4y, and so 


L,> y? y I ieee of 2y~' from Ghee a ze a 


tn 2 ine oO aged 
pe l 

> ep asia er} 
T 1 ;=0 41+ 3 


and this tends to infinity as n — oo. 


CHAPTER 7 


The Theory of Distributions 


1. Some Function Spaces. Partitions of Unity 


The theory of distributions plays a fundamental role in any modern 
treatment of partial differential equations (see [7, 11]) and it has impor- 
tant applications to harmonic analysis [14]. That theory will be in- 
troduced here. We will need some of the ideas presented in Sections 4.2 
and 4.3, and we must begin by discussing various spaces of functions 
defined on certain subsets of R”. In all that follows Q will denote a 
nonempty, open subset of R", where n is arbitrary but, in any discus- 
sion, fixed. When we speak of a “function in Q,” without any other 
qualification, we will always mean a complex-valued function that is 
defined in Q and is measurable with respect to Lebesgue measure in Q. 
The integral of any function in Q will always mean the Lebesgue 
integral, and if no limits are given, we will understand that the integra- 
tion is over all of Q. The space of all continuous functions in Q will be 
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denoted by C°(Q). Note that if f is in this space, then neither 
sup{ | f(x)| |x in Q} nor [ f(x) dx need be finite. 


Definition 1. For each f ¢ C°(Q) we define the support of f, supp f, 
to be the closure in Q of {x | f(x) # 0}. If supp fis a compact set then 
we shall say that f has compact support in Q. The set of all such 
functions (i.e, {f€ C°(Q)|supp f is compact!) will be denoted by 
C8). 


If fe C(R"), we can define || f|,, to be sup{| f(x)] |x in R". We 
leave it to the reader to show that (CQ(R"), ||°||,.) is a Banach space. 
Also, for any real number p > 1, we can put a norm |||, on Co(R") as 
follows: For each f in our space let |||, be the A, root of 
§ | f(x) |? dx. The et of the normed space (C$(R"), ||: ||,) is the 
Banach space (L,(R” ) [10]. 


Definition 2. For each nonnegative integer k let C*(Q) denote the 
space of all those functions in Q that have continuous partial deriva- 
tives of order up to and including 4; by the partial derivatives of order 
zero we mean, of course, the function itself. We define C6(Q) to be 
fe CQ Ww )| f has compact support in Q}. The spaces (\Z_9 C*(Q) and 
ara 0 oa ) will be denoted by C”(Q) and C8 (Q ), respectively. An 
element of Le ) will be called a C®-function in Q. 


It is easy to give examples of C”-functions in R". The function that 
takes each x = (x), X2,-...X,)in R" to |x|? =x} +++: + x7 is such a 
function. Recall that f(t) = exp(—t 7) fort > Oand = O fort < Oisin 
Co (R) [1, pp. 121, 250]. To give an example of a function in Co’(R") we 
just let w(x) = exp[— (1 — |x|?) '] for |x| < Land = 0 for |x| > 1. 
The support of oo is the unit ball of R”. By multiplying wo by a suitable 
constant we obtain a nonnegative C”-function w whose support is the 
unit ball ‘s R", which is positive in the interior of this ball, and for 
which { (x) dx = 1. We will make repeated use of this function. 


Lemma 1. If uv € C§(R") and if 6 > 0 is given, then we can find a 
function u, in Cg(R") such that |u(x)~u,(x)| <6 for all x; ie, 
CG (R") is dense in the Banach space (CO(R"), 


Proof. Choose « > 0 and define 


u,(x) = | u(x — ey)o(y) dy = 7" | u(y)o[(x — y)/e] dy. 
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It is clear from the second of these that we are integrating over the 
compact set supp u. For y € supp u, w[(x — y)/e] is nonzero only in the 
ball of radius ¢ centered at y. Hence u, is in C§(R"). But more is true. To 
compute any partial derivative of u,(x) we differentiate w[(x ~ y)/e] 
under the integral sign. Hence, since w is a C™®-function, 
u,(x x) € Co (R"). 
Now 


Jus(x) = u(x)] ser" | |u(y) - us)lo(*=") dy 


é "(integral of |u(y) ~ uso" =") 
over {y| |u(y) ~— u(x)| < 0}) + e ” (integral of this same function over 
{y| |u(y) — u(x)| > 5!). The first of these is 


< be" { wl(x — ye] dy < 6. 


To estimate the second integral we note that, since it has compact 
support, u is uniformly continuous. Hence there is a y > 0 such that 
|u(s') — u(x)| > 6 implies |x — y| > y. If we choose ¢ > 0 to be smal- 
ler than y, then w[(x ~ y)/e] = 0 for any y such that |x — y| > 7, ie, 
for any y such that | u(y) — u(x)| > 6. Thus for any such ¢ the second 
integral is zero. 


We are going to prove that C?(R") is dense in (L,(R”), ) for any 
real p > 1. In order to do this we will need another lemma, First recall: 
A real-valued function y on R is said to be a convex function if for each 
Xo € R there is an m in R such that w(t) > W(x9) + m(t ~ x) for all 
te R; ie, the graph of w lies above the ie that passes through 
(xo. W(xo)) and has slope m. The function y(t) = |1|? is a convex func- 
tion if p> 1. 


Lemma 2 (Jessen’s Inequality). Let y be a totally finite (ie., 
L(R") < 00), positive measure on R” and let f be a real-valued, p- 
integrable function on R”. Then for any convex function wy we have 


wf fdu/f du) < f Wf) du/f du. 


Proof. Setting xo = ff du/{ du we can, since y is a convex func- 
tion, find a number m such that w(f) => W(xo) + m(f — xo). Hence 
SWS) du = W(X) J du t+ mf fdj— mxo J du because yp is a positive 
measure. 
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Recalling how xo was defined we have 
[u(f) du = (| F dui | dx) | dutm | fdu= m( | f dp/ | au) | dj. 
Since 1 is totally finite we can divide by § dy. 


Theorem 1. For each real number p > | the space Cf (R") is dense 
in the Banach space (L,(R"), |: |,). 


Proof. Fix pand recall the nonnegative C®-function w introduced 
just before Lemma 1. Ifu € L,(R"), then, for any positive e, the function 


(x) = | u(x ~— eyjo(y) dy = 6°" { u(y)o[(x — y)/e] dy 


is well defined because w[(x — y)/«] is in L,(R"). We observe, as we did 
in the proof of Lemma 1, that u,(x) is a C®-function with compact 
support in R”. Thus, to prove the theorem, it suffices to show that u,(x) 
tends to u(x) for the L,-norm as ¢ tends to zero. 

The first thing that we want to establish is that |\u, ||, < ull,. We 
have |lu, 2 = | J u(x — ey)o(y) dy |? dx. Set w(t) = |r|’, recall that 
this is a convex function, and set du = u(y) dy. Then, by Lemma 2, 


J ux — eyo(y) dy PJ [u(x — ey) Poly) dy 
f wy) dy = foy)d | 


But since [w(y)dy=1, this says that |f u(x — eyko(y) dy? < 
J |u(x — ey) |Pea(y) dy. Now we can write: 


I/p 


lucy < ||] Jul — ey) Poo(y) dy dx 
, . 1/p 
= { oy) | |u(x — ey) |? dx iy| 
. 1/p 
= |llull2 | o(y) dy] = fal. 


Given 4 > 0 we choose a continuous function with compact sup- 
port (call it v) such that ||u — v|{,, < 9. Then clearly, {ju, — v, ||, < and 
sO 


Ju — Welly < lu — ellp + lle — velly + [lee — Mell» < 20 + [lo — ep 
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But, by Lemma 1, v, tends to v uniformly over R” as € tends to zero. 
Hence |v — v, ||, tends to zero with ¢ and the theorem is proved. 


We are now going to study C®-functions in Q. Our main result, 
which will take a while to prove, is that there exists a C’-partition of 
unity subordinate to any open covering of Q. 


Lemma 3. Let {Q,|v € /} be any open covering of Q. Then there is 
a countable, open covering {u,} of Q such that: 


(i) Each u, has compact closure. 
(ii) For each k there is a v with uc Q,. 
(iii) Each point of Q has a neighborhood that meets only a finite 
number of the sets {u,}. 


Proof. For each positive integer k let K, = {x € R"| distance of x 
to R"~Q is > 1/k and the distance from x to zero is < k}. Clearly 
each K, is a compact set in Q. Also, if int K, denotes the interior of K,,, 
K, c int K,,, for all k, and Q= (Jf, Ky. 

Let K, = @ for k <0. For each fixed i, L, = K; 0 {Q ~ int K;-,} 
is a compact set and V, = int K;,, © {Q ~~ K;_2} is an open neighbor- 
hood of this set. Each point x of L; has an open neighborhood W(x) 
that is contained in V, and is also contained in some Q,. A finite 
number of these neighborhoods, say W, ,, W,,2,.... Wi, qi, cover L;. 
Choose such a finite open covering for each i. Since W, ,; < K;,, for 
each i and all j, each of these sets has compact closure. Thus 
{W,,|i= 1, 2,...; 1 <j < [(i)} is a countable open covering of Q that 
has properties (i) and (ii). 

We are going to show that {W, ,} has property (iii). Let z ¢ Q and 
let i be the first integer for which z € int K;. Then z ¢ int K,;_ , and so 
we can find a neighborhood V of z such that V c int K,, 
Vn int Kj, = @. Let ye V0 W,, ;. Then y € W,,, and so y is in 
int Ky. 0 {Q~ K,,-2\. Now ifm <i-—2,thenm+ 1 <i-—2andso 
yin int K;_,. But V nm int K;_, = @. Thus m must be > i — 2. Also, 
if i+ l<m, then i-1<m-—2, and soi<m-—2. Then yeQr~ 
K,,-2 © Q~ K, <Q ~ int K;. But V c int K;, andsom<i+ 1. We 
conclude that Vn W,, ; # @ only for i—2<m<i+1, and so V 
meets only a finite number of the sets { W, ;}. 


Definition 3. Let {Q,|v € 1} be any covering of Q; we do not 
assume that the sets Q, are open, although they may be, and we do not 
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assume that / is countable, although it may be. If every point of Q has 
some neighborhood that meets only finitely many of the sets Q,, then 
we shall say that ‘Q,} is a locally finite covering of Q. 


Lemma 4, Let {U,\ be a countable, locally finite, open covering of 
Q. Then there is a countable, open covering {V,} of Q such that the 
closure of V, is contained in U, for each k. 


Proof. It suffices to find a sequence {V,} of open sets such that: (a) 
the closure of V, < U, for every k; (b) for each positive integer m the 
sets V, with k < m and the sets U, with k > m cover Q. 

We shall define the sequence {V,} by induction. If U is any subset of 
Q let cl U denote the closure of U in Q, Suppose that we have defined 
the sets YW, with k </ such that (a) is satisfied for k </ and (b) is 
satisfied for m < |. Let W = (ke: K) & (>, U;,). Clearly, W is open, 
and note that Q ~ U, c W by (b) with m= /— 1. There is an open 
subset Z of Q such that Q~ U,< ZcclZcW. If weset Y= Q~ 
cl Z, we have } CQ~ZcU,. Also, since Q ~ Z is closed in Q, 
cl V, c U;,. Finally, since V) vu W =Q, we see that (b) is satisfied for 
m=. 

One more lemma and we shall be able to prove our main theorem. 


Lemma 5. Let {U,) be a countable, locally finite, open covering of 
Q. Suppose that each U, has compact closure. Then there is a family 
{B,\ < Co (Q) such that: 


(i) f(x) =O for all x in Q and each k = 1, 2,.... 
(ii) supp f, < U, for each k. 
(iii) S32. , B(x) = 1 for each x € Q, 


Proof, By Lemma 4 we can find an open covering {V,} of Q such 
that cl ¥, c U, for every k; here cl V, denotes the closure of V,. Fix k 
and, for each x e cl V,, let B(x) be a closed ball centered at x and con- 
tained in U,,.Since cl V, is compact it can be covered by the interior of a 
finite number of these balls, say B,;, B,,..., B,. For each i, | <i < J, let 
x, be the center and ¢, the radius of B;. Let w be the function introduced 
just before Lemma 1! and define p,(x) to be e; "w(x — x;)/e;] for i = 1, 
2, ..., 4 Clearly, each p; is a nonnegative function in C7(Q). Also, 
supp p; = B; and p; > 0 in the interior of B; for each i. It follows that 
the function y,(x) = )4-, p(x) is in CF(Q), supp », c U,, and », > 0 
on cl ¥,. 
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Now recall that {U,}! is locally finite and that {Y,) covers Q. Thus 
(x) = V1 7x(x) is a well-defined C*%-function in Q that is positive at 
each point of Q. Clearly, the sequence f,(x) = 34(x)/7(x), k = 1, 2,..., 
satisfies conditions (i), (ii), and (ili). 


Theorem 2. Let {Q,.|v © /' be an open covering of Q. Then there is 
a family {a,|v € /} of C®-functions in Q such that: 


(a) a,(x) > 0 for all x e Q and each v € J. 
(b) A, =supp «, <Q, for each v € J. 

(c i {A,|v € I} is locally finite; 

(d) Siewinene 1 for each x € Q. 


The family {a, |v € 1} is called a locally finite, C%-partition of unity 
subordinate to the covering |Q,|v € J}. 


Proof. By Lemma 3 there is a countable, locally finite, open cover- 
ing {U,} of Q, with each U, having compact closure, such that each U, 
is contained in some Q,. Using {U,' and Lemma 5 we can find a 
sequence [f,' < Cg (Q) having properties (i), (ii), and (iii) of that 
lemma. For each positive integer k let I(k) = {ve T|U, <Q}. Each of 
these sets is nonempty and so, by the axiom of choice [15, Theorem 25, 
p. 33], there is a function T from the positive integers into J such that 
T(k) € I(k) for every k. For each vel define a,(x) to be 
Y. {B,(x) | T(k) = v}. Clearly, fa,(x)} is a family of C*-functions that has 
property (a). 

To prove that {a,} has property (b) first set C,= 
(}{supp B,|T(k) =v}. Clearly C,<Q,. Suppose that xe A,= 
supp a,. Then every neighborhood of x meets some set supp f,, where 
T(k) = v. On the other hand, some neighborhood of x meets only a 
finite number of the sets U,, hence only a finite number of the sets 
supp f3,. It follows that for some J, with T(J) = v, x € supp f,. But then 
x € C, and we have shown that A, < C, <Q, for each v € J. Thus {a,} 
has property (b). In order to prove that {a,} has property (c) it suffices 
to prove that the family {C,|v e J! is locally finite. For each x e Q 
there is a neighborhood V of x and a finite set H of positive integers 
such that Vm U, = @ for k ¢ H. Then V cq supp f, = @ for k ¢ H. 
From this we see that if v ¢ {T(k)|k © H} then, since C, would be the 
union of sets supp f,, where k¢H, VOC,= oD. But since 
{T(k)|k € H} is a finite set we have shown that iC. is a locally finite 
family. 
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Finally, for each x € Q, 


I= YAwy= TL] Y Babs 


vel lTUj=v 


= 2 o4(%) 


Corollary 1. Let O, C be two subsets of Q, O an open set, C a 
closed set, and suppose that C cO <Q. Then there is a function 
ob € C*(Q) such that: 


(i) O< (x) <1 forall x EQ; 
(ii) (x)= 1 forallxec. 
(iii) (x) = 0 for all x eQ~O. 


Proof. There is a C®-partition of unity (call it a,, #2) that is 
subordinate to the open covering O=Q,, Q~C =Q,. Clearly 
(x) = (x) for all x has properties (i), (ii), and (iii). 


EXERCISES ! 


+l. A multi-index is an ordered n-tuple of nonnegative integers. If 
$= (51,82, -.-,5,) is a multi-index we let |s| =s, +52 +++ + 5, 
and, for each fin C'*!(R"), we let 


of 

Let K be a fixed, compact subset of R” and let “%,(R") = 

{fe Cg (R")|supp fc K!. For each nonnegative integer m define 

Pm as follows: p,,(f) = sup{|D*f(x)| |x € K, |s| <m)} for each 

fe %,(R"). 

(a) Show that each p,, is a seminorm on “,(R") (Section 4.2, 
Definition 3). 

(b) If fe “x(R") is not the zero function show that p,,(f) # 0 
for some m. 

(c) The family {p,,|m = 0, 1, 2,...} defines a Hausdorff, locally 
convex topology on “,(R") (Section 4.1; see the construc- 
tion process just after Lemma 1), Call this topology t({p,,}). 
Show that there is a countable fundamental system of 
t({p,} }-neighborhoods of zero in “,(R"). 
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*2. Let X be a vector space over K and let {p,} be a countable family 
of seminorms on X. For each positive integer m define q,,(x) to be 
sup{p,(x)| 1 <j <m} for each x € X. 

(a) Show that each q,, is a seminorm on X and that q,,(x) < 
m+ (x) for all x € X and each m= 1, 2,.... 

(b) If {p,} satisfies the separation condition (Section 4.1, Lemma 
2) then so does {q,', and conversely. 

(c) Show that the families {p,} and {q,} define equivalent topolo- 
gies on xX, Hint: It suffices to show that every 
t({p,})-neighborhood of zero in X contains a 
t({q,{)-neighborhood of zero, and conversely. 


3. (a) Let Q be any open subset of R”, and let C be a closed subset 
of Q and O an open subset of Q such that C c O. Show that 
there is an open. subset W of Q © such that 
CcoWcdwWwcdO, 

(b) Prove that the union of any locally finite family of closed 
subsets of R” is a closed subset of R”. 


2. Fréchet Spaces 


Locally convex spaces whose topologies can be defined by means of 
a countable family of seminorms arise frequently enough to warrant 
some special attention. The one example we have seen, “,(R") (defined 
in Exercises 1, problem 1) will be useful later on. Another useful 
example will be given at the end of this section. 


Theorem 1. Let X be a vector space over K and let t be a Haus- 
dorff, locally convex topology on X. Then the following are equivalent: 


(a) The topology t is metrizable. 

(b) There is in X a countable, fundamental system of t- 
neighborhoods of zero. 

(c) The topology t can be defined by means of a countable family 
of seminorms that satisfies the separation condition. 


Proof. It is clear that (a) implies (b). Assume (b) and let {U,,} bea 
countable, fundamental system of t-neighborhoods of zero in X such 
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that U, > U,4, for all n. We may assume that each U, is absorbing, 
balanced, and convex (Section 4.3, Lemma 2). Let p, be the gauge 
function of U,, for each n (Section 4.2, just before Definition 1). Then 
(Section 4.2, Theorem 1) each p, is a seminorm on X, Clearly, the 
topology defined by the family {p,} coincides with t (Section 4.3, proof 
of Theorem 1). To prove that (c) implies (a) we need: 


Lemma 1. Let s be a Hausdorff, locally convex topology on X 
defined by a sequence of seminorms {p,} such that p,(x) < p,4 (x) for 
all x and all n. For each x € X define |x| to be )*, 2°>"p,(x) x 
(1 + p,(x))” '. Then: 

(i) |x| =Oiffx=0. 

(ii) |x| = |—x| for each x eX, 

(iii) [x+y] < |x| + |y| for all x, yin X. 

(iv) For any xeX and any 2eK such that |A| <1, 
|Ax| < |x|. 

(v) Ifthe sequence {A,} (of scalars) converges to zero, then, for 
each x € X, {|A,x|} converges to zero. 


Finally, if we define p(x, y) to be |x — y| for allx, y « X, then pisa 
metric on X and p is translation invariant; ie. p(x + z, y+z) = 
p(x, y) for all x, y, z in X. 


Proof. Properties (i) and (ii) of |-| and the fact that |x| > 0 for 
all x, are obvious. The function that takes each real number « to 
a(1 +a) * is an increasing function for « # —1 (just take its deriva- 
tive). Hence: 

(1) a(1+a)' < B(1+ B)! for —l<a<f. 
If Je K, |A| <1, then p,(Ax)= |A|p,(x) <p,(x) (Section 4.1, 
Definition 1). Using (1) we may write 
PrlAX)(L + py(AX))”* < Pa(x)(L + Pa(x)) ! 
and property (iv) follows from this. 

We shall use (1) to prove (iii). Recall that p,(x + y) < p,(x) + Pa(y) 
(Section 4.1, Definition 1), Hence 
Pal + YL + Pal + Y)7! < (Pal) + Pay) + Pal) + Pal)” * 


< Pax) + Pax)! + pay) + Pal)” 
and (iii) follows from this. 
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Properties (i), (ii), and (iii) imply that p(x, y) = |x — y| is a trans- 
lation invariant metric on X. Let s’ be the topology defined on X by p. 
We shall investigate the relationships between the s- and the 
s'-neighborhoods of zero in X. 

Let U = {x e X| |x| < 27~*}. Weshall show that U contains the set 
V = {x EX | py (x) 2747 OL. If xe V then p,(x) < p2(x) <°° < 
Pus i(x) < 27 %*) and so, since p,(x)(1 + Pa(x))”' < Pal), 


k+ on 
(2) yD (el 4px) 2 Yo a ey 
ae n=1 
On the other hand p,(x)(1 + p,(x))”' < | and so 
(3) D2 "palx)(l + Pax) 1 < D278 = 27-84, 
k+2 k+2 


Combining (2) and (3) we get |x| <27* and so xe U. Thus s is 
stronger than 3’, 

Now let W = {x € X|p,,(x) < 2>("*** )) We shall show that W 
contains W’={xeX| |x| <2°*** If x © W, then certainly 
2 ™Dm(X)(1 + Pm(X))7 | < 27" ***). From this it follows that p,,(x) x 
(1 + pa(x))7' <27%* and that p,,(x)(1 —27%*?) < 27+), Thus 
P(X) <2°>%* 9) — 1 <27* which says x € W. 

If {1,} is a sequence of scalars that converges to zero, then for each 
x € X the sequence {A,x} is s-convergent to zero, But then {A, x} is 
s'-convergent to zero and this proves (v). 

Since every s-neighborhood of zero contains an s’-neighborhood of 
zero, and conversely, and since p is translation invariant, the topolo- 
gies s and s’ must coincide on X. 


We now return to the proof of Theorem 1. Assume (c) and let {p,} 
be a sequence of seminorms such that ¢ = t({p,!). By problem 2 of 
Exercises |, there is an increasing sequence of seminorms {q,} on X 
such that t = ¢({q,}). But, by Lemma 1, t({q,\) is metrizable. 


Definition 1. A locally convex space whose topology is metrizable 
will be called a metrizable, locally convex space. A complete, metri- 
zable, locally convex space (i.¢., one in which every sequence that is 
Cauchy for the metric converges for the metric to a point of the space) 
will be called a Fréchet space. 


Remark, Let X{t] be a locally convex space. We recall (Section 
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4,3, Definition 3) that a subset B of X is said to be t-bounded if for each 
t-neighborhood, say V, of zero in X there is a scalar 4 such that 
B < AU. Suppose that t is a metrizable topology and that p is a metric 
that defines r. A set B < X is bounded for the metric if sup{p(x, y)|x, y 
in B} is finite. Note that such a set need not be t-bounded. In fact, 
Lemma | shows that X can be bounded for the metric. Whenever we 
speak of a bounded subset of a metrizable, locally convex space X(t] 
we shall always mean a set that is t-bounded in X. 


Let s = (s,, 52, ..., 8,) be a multi-index (Exercises 1, problem 1). 
We define s! to be s,! 52! ... s,! and, if x = (x, ..., x,), x* to be 
xix? «+ xf". If m is any positive integer then (x, + x. +:°: + x,)" = 


Dd {(mt/st)x*| || = m). 


Lemma 2. For a C“®-function fon R" the two following conditions 
are equivalent: 


(1) For any positive integer k, any multi-index s, and any ¢ > 0, 
there is a number o>0O such that |(1+ |x|?)MDf(x)| <e for 
|x| >a. 

(2) For any two multi-indices r and s and any ¢ > 0 there is a 
number o > 0 such that |x’D'f(x)| <¢ for |x| >. 


Proof. The expression (1 + |x |?) is a linear combination of mon- 
omials of the form x7” = x?/!x3?? «++ x2", with |r| <k. Hence, for any 
multi-index s, there is a constant M such that 


max{|(1 + |x|?)'DY(x)| |x € R"} 
<M max max{|x’D*f(x)| | |r| < 2k, x © R"}. 


Thus (2) implies (1). But since |x’| < (1+ |x|?) for |r| < 2k, we see 
that (1) implies (2). 


Definition 2. A C®-function on R” is said to be a rapidly decreas- 
ing function on R" if it satisfies condition (2) of Lemma 2. The set of all 
rapidly decreasing functions on R" will be denoted by (R"). 


It is obvious that (R") is a space of functions on R” (Section 1.2, 
paragraph before Exercises 2) and that C?(R") < ¥(R"). Also, if fis an 
element of .¥(R"), then so is any partial derivative, of any order, of f- 

We can define two countable families of seminorms on “(R"). 
First, for any two multi-indices r and s, we can define q, ,(f) to be 
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max{|x’D*f(x)| |x € R"} for allf € Y(R"). It is obvious that each gq, , is 
a seminorm on ¥(R"), that {q, ,} is a countable family, and that this 
family satisfies the separation condition. The second family is defined 
as follows: For each positive integer k and each multi-index s let 
Px, (f) = max{|(1+ |x |?)*D(x)| |x eR" for all fe ¥(R"). The 
family {p,, ,} is a countable family of seminorms that satisfies the separ- 
ation condition. By Theorem | each of these families defines a metri- 
zable, locally convex topology on “(R"), The proof of Lemma 2 shows 
that these two topologies are equivalent. 


From here on we shall always assume, often without explicit 
mention, that “(R") has the metrizable, locally convex topology 
defined by one or the other of the families of seminorms discussed 
above. We shall denote this topology by t,. 


Theorem 2. The space ¥(R") is a Fréchet space, and Cf(R") is 
dense in this space. 


Proof. Let {f,,} be a ty-Cauchy sequence of points of #(R"). Then 
lim q,. sf, — Sm) = 9, as m, n tend to infinity, for any r and s. Let 
|r| = 0. Then, by letting |s| =0, 1, 2, ..., we see that {f,}, and each 
{D*f,,}, is uniformly Cauchy over R". So { f,,} converges, uniformly over 
R", to a function f. The function fe C%(R") and, for every s, {D°f,,} 
converges uniformly over R" to D*f. It follows that {x’D*( f — f,,)} tends 
to zero, uniformly over R", as m tends to infinity, for every fixed pair r, 
s. Hence the inequality 

| x"D°f(x)| < |x"D°(f— Fax) | + |x"D*falx) | 
shows that fe A(R"). 

In order to prove that C§(R") is dense in Y(R") we first use the 
Corollary to Theorem 2 (Section 1) to find a C*-function y such that 
0 < (x) < I for all x, y(x) = Lif |x| <1, and (x) = Oif |x| > 2. Let 
fe F(R") and ¢>0 be given. Let k be a positive integer, let s be a 
multi-index, and for any integer j let y,(x) = y(x//). Then 


[(1 + |x PD { f(x) — 7(x))} | 
<¥ G)|D7'U — yx) [1+ |x PDF (X) |. 


where (3) =s!/rl(s—r)! and s—r=(s;—1y, Sy —1g,--+5 Sp — Pn): 
Suppose that we have / summands. There is a constant C such that 
| D*“"(1 — y,(x))| < C for all x; C is independent of j. Also, there is a 
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a >O such that |(1 + |x|?)‘D'f(x)| < e/(IC) for |x| >o and |r| < 
| <e 


|s|. By choosing j > o we have |(1 + |x |?)‘D*(f(x) —S(x)y,(x)) 
for all x. 


EXERCISES 2 


1. Show that %,(R") in problem 1 of Exercises 1, given the topology 
defined by the countable family of seminorms also discussed in 
that problem, is a Fréchet space. 

2. Let X[t] be a metrizable, locally convex space and let {B,' be any 
sequence of t-bounded subsets of X. Show that there is a sequence 
of positive numbers {A,} such that (}%. , 4, B, is a t-bounded set. 
Hint: First show that we can assume that B, < B,,, for all n. 
Next let {U,} be a decreasing, fundamental sequence of f- 
neighborhoods of zero in X and, for each n, choose 4, so that 
i, B, < U,. 

+3. (a) Show that exp(— |x|?/2) is in “(R). Hint: Use L’Hospital’s 
rule. 
(b) If @ € Y(R) show that |f (x) exp(—ixy) dx| is finite for 
every fixed y. 
(c) Prove that | e~*”? dx = (22)'/? as follows: First note that 
[fe *? dx]? = ff exp[—(x? + y)/2] dx dy. Then evaluate 
this double integral using polar coordinates. 


3. The Fourier Transform 


For f in L,[—2, x] we defined the Fourier transform f of f to be 
(1/2n) § f(x)e""* dx, n=0, +1,... (Section 6.1, Definition 1). We 
saw that f has some useful properties and we found that the map that 
takes each f € L,[—7, 2] to fhas an inverse (Section 6.1, Theorem 3). A 
similar “transform,” also called the Fourier transform, can be defined 
for many classes of functions, and even more general objects. For 
example, if feL,(R), then we may define f(y) to be 
(1/2)'/? | f(x)e~” dx. (Some writers leave out the factor (1/2m)"/?, 
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and others replace it by 1/2z. For a discussion of this point see [14, 
p. 122].) Clearly, | f(y)| < (1/2z)'/?\¢||, and, by trivially modifying 
the proof of the Riemann—Lebesgue theorem (Section 6.1, Theorem 1), 
rn can show that lim,... f(y)=0. Also, since | f(y + z)—- 

y) Ae | f(x)| {e®? — 1] dx and the integrand is bounded by 
, 1 f(x)| and tends to zero everywhere as z > 0, fis uniformly contin- 
uous. So we have a map, f > f, that takes each f € L,(R) to a function 
that is uniformly continuous and vanishes at infinity on R. Note that it 
is helpful to have two real lines in mind here. One of them, R, is the 
domain of our L,-functions and the other one (call it R) is the domain 
of their Fourier transforms. 

Now what properties does the map f— fhave? In particular, does it 
have an inverse? Also, since R has infinite measure, L,(R) is not con- 
tained in L,(R) when p> 1. So how would we define the Fourier 
transform for fe L,(R), p> 1? We shall be able to answer these 
questions at the end of this section. A more detailed treatment of the 
Fourier transform on L,(R) can be found in [8] or [14]. The latter also 
contains a discussion of the Fourier transform on L,(R). For a much 
more general treatment of the entire subject see [9]. 


Definition ‘e For each function @ in ¥(R) let $(y)= 
(1/2n)'/? | b(x)e7' dx. We regard the function $(y) (Exercises 2, 
ai 3b) Y Aeaaee on a second copy R of R. 


Lemma 1. For any function ¢€.%(R) the function ¢ € /(R). 
The map, call it ¥, that takes each function @ € .#(R) to the function 
@ € Y(R) is linear and continuous. 


Proof. Choose ¢€-(R). We shall first show that @ is a 
C®-function. For any p we have: 


(x) D?d(y) = Sate { xPp(x)e~® dx. 


We may write 


xP(L + x?)P**(x) 


Pp = Wiens at 
|x (x) | (1 xtyrt bd 
where k is an integer, and if |x| > 1, then 
(#*) |x’h(x)| < Bale max |(1 + x?)?**#(x)]. 


(1+ x2 ™ 
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However, @ € “(R), and so the maximum is finite. Thus, since 
J (|x PL +x 2)p+*) dy is clearly finite, @ is a C”-function. 
Return now to the definition of @ and integrate by ake We get 


soy fob 1p age™ 
BL) = iggy ~iy ie on? | ~iy - dx 


The first term on the right is zero because @ € .Y (R). Repeated integra- 
tion by parts gives (iy)*b(y) = (1/22)!/? | D%p(x)e7*” dx. Combining 
this equation with equation e above we get 


(+**) (iy)'D°@(y) = iN | Difxrpx)len dx. 


Hence, for any o>0, | ene < |f D%[x?p(x)Je7' dx | over 
{x||x| <a} plus [ |D%[x?@(x)]| dx over r{x]]x| > a}. We shall use this 
as to show that, for any ¢ > 0, y*D?o(y) | is less than ¢ for all y 
sufficiently large. This will prove that @ € .(R) (Section 2, Definition 
2). The first term on the right-hand side of our inequality is of the form 
fu, f(x)e"*” dx, where o is fixed and f is differentiable. The proof of 
the Riemann-Lebesgue theorem (Section 6.1, Theorem 1) shows that 
this term tends to zero as y > +00. We will now show that the second 
term can be made as small as we please by taking o sufficiently large. 
At the same time we shall see that ¥ is continuous. 
Suppose first that p= 3, q=2. Then f |D%[x?d(x)]| dx over 
{x| |x] > o} becomes 


[ [D>LxF¢(x)] | dx 


< | |x?"(x)| dx +6 | [x2¢'(x)| dx + 6 | [xd(x)| dx 
(by the Leibnitz formula). Using inequality (**) we find that 
| [DLS e(x)]| dx 
© 1 2)\3 +k py d |x |° 
<max{|(l+ 7 P61 20) | yy yaya 
plus two similar terms. Since each of the functions ¢, ¢’, d” is in. Y(R) 


and, for k sufficiently large, each of the integrals is convergent we see 
that [ | D?[x>¢(x)]| dx can be made as small as we please by taking o 


dx 
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sufficiently large. Also, recalling the definitions of the seminorms q, , 
and p,,, (Section 2, just after Definition 2), we see that: q>, 3(@) = 
max | y>D?6(y)| < Mp3+x.2(@) plus two similar terms; here M is a 
constant that is greater than { (|x |?/(1 + x7)>**) dx. It follows that F 
is continuous. 

The proof for the general case is similar to the one just given 
because, by the Leibnitz formula, D[x’¢(x)] is a linear combination of 
terms x’D*(x). 


It will be useful to know the Fourier transform of e~*”?. This 
function is in “(R) (Exercises 2, problem 3a) and we shall need the 
formula proved in part (c) of that problem. 


Lemma 2. 


(1/2n)'/? [ 7 #72g- ty dx =e M/?, 


Proof. First write 


A a + \2 
(1) | ee at cal | exp |=" --- | a 


ae bog 
For any v>0O the Cauchy integral theorem shows that 
fc exp(—z?/2) dz = O if C is the rectilinear path joining —A to A, A to 
A+ iv, A+ iv to —2 + iv, and —A + iv to —A, Hence we may write 


0= (" exp(—1?/2) dt + | exp[—(a + iu)/2]i dv 
"4 "0 


{=a .0 
+ | exp[—( + iv)?/2] dt + | exp[—(—A + iu)?/2]i du. 


Notice that the second and fourth terms in this equation tend to zero 
as A tends to infinity. Transposing the third term we find that 


i> 6) @ 


| exp[=(¢ + iv/2] dt =] exp(—1?/2) dr. 


Combining this with (1), 


+X 2) 
a a ed BY ae ae 


. 
— 0 -—@ 
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Finally, if @(x) = e7*’?, then 
7 | ; . ./2n 
ye xe PS dx = VY pi PP = er PP, 
p(y) 2m | P( ) a Jon 
We want to prove that the map #¥, defined in the statement of 
Lemma 1, has a continuous inverse. To do that we shall need Lemma 2 


and the next result. 


Theorem 1 (Parseval Relations). For any two functions ¢, y in 
4(R) and ¥(R), respectively, we have { $(y)W(y) dy = J o(x)b(x) dx. 


Proof. 


| O(oore” dy = [ w) 
= | 
& | W(z — x)(z) dz, 


where we now regard w as a function in. “(R). Setting w = z — x in this 
last expression we find: 


(1/2n)'/? | p(z)e ts}en dy 


(yam? | ogre 9 dy ed 


(+) | By WUr)e™ dy = | low)o(w + x) dw. 
Our result follows from («) upon setting x = 0. 


Observe that, if y € 7(R), for any ¢ > 0 the function (x) = (ex) 
is in Y(R) and $(y) = (I/e)H(y/e) 


Theorem 2. The map .¥ that takes each element of (R) to its 
Fourier transform has an inverse that is linear and continuous. In 
particular, ¥ is one-to-one and onto. 


Proof. Define a linear map from .¥(R) to “(R) as follows: For 
each y in (R) let P(x) = (1/2n)'/? J w(y)e'*” dy, and let our map take 
y to p. Anticipating our result, we shall denote this map by ¥~ '. It is 
clear that ~~ ' is linear and the proof of Lemma 1 shows that it is 
continuous. So all we have to do is prove that ¥ and .¥~! really are 
inverses of each other. 
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For w in Y(R) and any fixed «> 0 let a(y) = we 'y). Then, as we 
observed above, &(z)=« 'p(z/e). Equation (*) in the proof of 
Theorem 1 reads, in this case, [ a(y)P(y)e*” dy =  a(w)p(w + x) dw 
and this is equal to e~! [ b(e~ 'w)p(w + x) dw = J b(u)h(x + eu) du 
where u = ¢~'w. If, in particular, we take y(x) to be exp(—x?/2), then 


| expl— (ey? /2]b (ye dy = | h(w)o(x + eu) du 
In this equation let ¢ +0. We find: 
[ (ye dy = G(x) | Gu) du = G(x) | exp(—u?/2) du = (2n)"74(x), 


by Lemma 2. Thus (2z)!!?[6(x)] = (22)"2(x), which proves the 
theorem. 


Theorem 3 (also called Parseval’s Relation). For any two func- 


tions ¢, y in .(R) we have f o(y)(y) dy = J $(x)b(x) dx, where the 
bar denotes complex conjugation. 


Proof. By Theorem 1, f d(y)W(y)dy =| O(x)P(x) dx. Since 
b(y) = F[A(x)] we need only show that (x)= .F[P(y)]. But 
Fly i= (1/2x)''? | P(x)e~* dx = complex conjugate of 


(1/2n)"? | w(xye™ dy = D(x) 


At this point the reader may well wonder what it is that we are 
doing. After all, it is clear that L,(R) is not contained in .(R).So how 
is the Fourier transform on “(R) going to help us answer the 
questions raised earlier? The answer is rather interesting. What we 
shall do is show that L,(R) is contained in the “dual” of the locally 
convex space .(R). Our results so far, about (R), will enable us to 
define a Fourier transform on this dual. Thus, in particular, we get a 
Fourier transform on L,(R) this way. We shall make all this precise 
now. 


Remark. Let X[t] be a locally convex space. The vector space of 
all t-continuous, linear functionals on X will be called the dual space of 
X[t] and will be denoted by X’. X’ is not the trivial vector space 
(Section 4.4, Corollary 1 to Theorem 1). For each fe X’ let p,(x) = 
| f(x)| for all x € X. The family {p, | fe X'} defines a locally convex 


120 7. THE THEORY OF DISTRIBUTIONS 


topology on X (just as in Section 4.1), which we shall call the weak 

topology on X and denote by o(X, X’). Similarly, we define a weak* 

topology o(X’, X) on X’ by means of the family {p,|x € X}, where 
= | f(x)| for all fe xX’. 


Definition 2. A continuous, linear functional on (R) will be 
called a temperate distribution in R. The set of all temperate distribu- 
tions in R (ie., the dual of “(R)) will be denoted by ’(R). 


Lemma 3. For Te #’(R) let T(¢) = T(@) for every @ € Y(R). 
Then T is in.¥’(R). Furthermore, the map & that takes each T € #’(R) 
to T € ¥'(R) is continuous when these two spaces have their weak * 
topologies. 


Proof. If Te .¥(R) then T(p) = T(p) = T » F(¢). Since both F¥ 
and T are continuous, T is continuous, ie., T € ¥'(R). 

Since Y is obviously linear we shall have proved that it is contin- 
uous once we have shown that it is continuous at zero. Let U be an 
arbitrary weak * ene of zero in .f'(R). We may assume that 
U={Te ¥(R)||T(¢,)| <6; for | <j <k}. Then 


G'(U) ={S €. ¥(R)|G(S) € U} = {Se ¥(R)|S EU} 
= {Se .¥(R)| |S(¢;)| <e for | <j <k} 
= {Se ¥'(R)| |S(¢,)| <¢, for 1 <j <k}. 


Since this last set is a weak* neighborhood of zero in Y’(R) we are 
done. 


Definition 3. For each T € ¥’(R) we define the Fourier transform 


of T to be the temperate distribution T, where T7(¢) = T(@) for all 
o € ¥(R) (see Exercises 4.1, problem 4). 


Lemma 4. For fe L,(R), 1 <p <, let T,(6) = § f(x)b(x) dx 
for every ¢ € (R). Then T; is a temperate distribution in R. Further- 
more, if f, gare in L,(R) and T;(@) = T,(@) for all @ « .Y(R), then f= g. 


Proof. If @ € A(R) and ¢ > 0 are given, we can choose o > Osuch 
that |(1 + x?)*b(x)| <e for |x| >o,and so |P(x)| <e(1 + x?) “for 
|x| > 0. Now |f f(x)6(%) dx] < f | F(0)G(x)| dx over {x] |x] <0} + 
F LF ee)6(x)] dv over fx] |x] > o} 
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The first of these is finite because (x) restricted to [—o, a] is in 
L,(R). The second term is <« { | f(x)(1 + x?) “| dx over {x||x| > o}, 
and this is < el ||, ||(1 + x?)~*||,, which is finite for k sufficiently large. 
Thus we have shown that T, is a linear functional on .“(R) and a 
similar argument shows that T, € .’(R). 

Now let f, g € L,(R) and suppose that T, = T,. Then, in particular, 
J f(x)b(x) dx = § g(x)b(x) dx for all 6 © CR(R). Hence, if p > f= g 
because Cg (R) is dense in the Banach space L,(R) (Section 1, Theorem 
1). If f, g are in L,(R) we have f,(x)=J f(x — ey}o(y) dy = 
é-' f f(y)o[(x — y)/e] dy and, by hypothesis, this is equal to 
é-' J g(yyo[(x — y)/e] dy = g,(x); here @ is the function defined in Sec- 
tion 1 just before Lemma 1. Now, as ¢ > 0, f, and g, tend to fand g, 
respectively, for the L,-norm (Section 1, proof of Theorem 1). Thus 


f=. 


Whenever it is convenient we shall identify the L,-function f with 
the temperate distribution T,. We can, and do, define the Fourier 
transform of f to be T,(Definition 3 above). 

For f € L,(R) we defined f(y) to be (1/2)? f f(x)e~™ dx and we 
noted that, in particular, fe L,(R). Let us show that the temperate 
distribution T, is equal to T’,. 


TAG) = | F)B(x) dx = | SOx) |(1/2m)"? | (ye? ay 


(Definition 1). By Fubini’s theorem [19, Theorem 19, p. 269] this is 
equal to 


|e) 2m | fede” ax| dy = | &y)F(») dy = Td). 


Thus for functions in L,(R) our new definition of the Fourier trans- 
form is consistent with the one we gave earlier. It follows that the 
Fourier transform on L,(R) has an inverse. 


dx 


Plancherel was the first to show how one could define a Fourier 
transform on L,(R). He also showed that the map that takes each 
f¢L,(R) to its Fourier transform is an equivalence (Section 3.1, 
Definition 2) from this space onto itself. The definition of the Fourier 
transform given by Plancherel is different from the one given above [8, 
p. 47]; we can however, still get his results. 


Theorem 4. If fe L,(R) then there is a function fe L,(R) such 
that T,= T;. Furthermore, | f\| >= |\ f || 2. 
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Proof. It follows from Theorem 3 that |||, = ||@l|2 for each 
pe Y(R). Thus |7;(¢)| < ||fl2|}¢|l2 for all @e-4(R). Now this 
inequality holds for all @ € Cg(R) and the latter is norm dense in 
L,(R) (Section 1, Theorem 1). Hence T, defines a continuous, linear 
functional on the Banach space L,(R). But then there is an fe L,(R) 
such that ||T;|| = f], and T,(g) = J g(x) f(x) dx for all g € L,(R). 

Now work with the temperate distribution T; and its Fourier trans- 
form. As ee there is a function fe L,(R) sich that ||T,|| = Ifill. 
and T;(g) = § g(x) )f (x) dx for all g € L2(R). In the first Saraereph of 
this proof we saw that, in particular, T;= T; on C%$(R). Since the 
latter space is dense in (R) (Section 2, Theorem 2) we must have 
t= T; on Y(R). Thus T,= T, and so f(x) )f (x) dx = 
{ f(x)O(x) dx for all @ € CB (R). 

, Te £(R),¢ € Co(R) then T(¢) = T(¢) and it is easy to see that 
$(x) = o(— x). Thus 


| bx) P(x) ax 


= | F0x)B(x) dx = | $0)4( = x) dx = | S(— x)6(x) dx, 


and eae Lf (x) —f(—x)](x) dx = 0 for all ¢ € C%(R). Clearly, this 
means f(x) = i x) almost everywhere in R; note that |||, =f'l|2- 
But || flo < fil, < fl], by the first part of the proof. We conclude 
that ||fl> = | f|2 for all fe L,(R). 


Corollary. For Gare oo f (x) is the limit, in the Banach space 
L,(R), of {(1/2n)'? fu, f(yje' dy|h > 0} as h > o. 


Proof. For h> Osetf,(x) =f (x) when |x| <h,and set it equal to 
zero otherwise. Clearly, lim, ... || f,—S||2 =9 and, since fof is an 
equivalence on L,(R), hence f(x) is the norm limit of f,. In the proof of 
the theorem we saw that 


| ldo(x) dx 


dx 


= f 0984s) dx = | F¢) 


(1/2n)'? | bye dy 


for all @ € C#(R). Since f, is obviously in L,(R) we can change the 
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order of integration to get { [(1/2n)'? J*%, f(x)e7*” dx]@(y) dy. The 
corollary now follows from the fact that Cg?(R) is dense in L,(R). 


Remark. Many of the results of this section are valid when the 
various function spaces are defined on R", n> 1. When stated in this 
more general form they have important applications to the theory of 
partial differential equations (see [11, 28]). 


4. Distributions: Definition and Characterizations 


A distribution in Q (recall that Q is an open subset of R") is a linear 
functional on C#(Q) that is continuous for a certain locally convex 
topology on this space. We shall define that topology now. 

Let .# be the family of all compact subsets of Q. For each K € # 
let %,(Q) = {fe CF(Q)|supp f< K} and, for each nonnegative 
integer m, let p,,(f) = sup{|D*f(x)||x € K, |s| <m\. Each p,, is a 
seminorm on “%x(Q) (Exercises 1, problem 1), and the family 
{P,|m = 0, 1, 2, ...} defines a metrizable locally convex topology on 
this space, which we shall denote by t,x. Also, %(Q)[t,] is a Fréchet 
space (Exercises 2, problem 1). We can now define a topology on 
Ce (Q) as follows (the terms used were defined in Sections 4.2 and in 
Exercises 4.2, problem 1b): 


From each of the spaces &x(Q) choose a tx- neighborhood of zero, 
Ux, which is absorbing, balanced and convex, and let U be the convex 
hull of () {Ux |K € #}. Let & be the family of all sets which are con- 
structed in this way. 


We are going to show that there is a unique Hausdorff, locally 
convex topology (we shall call it t*) on Cg(Q) that has # as a fun- 
damental system of neighborhoods of zero. Before doing that, 
however, we must mention some of the properties of the sets in this 
family. For any set S denote the convex hull of S by conv S. 


(i) If U, V are in 4%, then U A V contains a set in %. 


Proof. We have U = conv (J {Ux|K € #}, 
V =conv |) {Vx | Ke #} 
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where each U,, Vx is an absorbing, balanced, convex neighborhood of 
zero in &x(Q)[t,]. Clearly, each of the sets Ux, m Vx also has these 
properties and U mn V >conv (} {Ux 0 Vy | K € #}. 


(ii) {UU ew, = 0. 


Proof. Any fe CR(Q) is in some “x(Q). Iff is also in every set in 
4M, then it is in every tx-neighborhood of zero in this F,(Q). But since 
tx is a Hausdorff topology, f = 0. 


(ili) If U € 4 and a is a positive scalar, then oU € %. 


Proof. We have U = conv |) {Ux|K € #}. So if y € U, then we 
must have y = )7_, a, y;, where each y, is in some Ux, 2%; > 0, for 
i=1,2,..., n,and )7_, a; = 1 (Exercises 4.2, problem Ib). But then 
ay = ¥ a,(ay,), which says ay is in conv |) {Ux | K € #}. Since each 
of the sets gU, is an absorbing, balanced, convex neighborhood of 
zero in %,(Q), this last set is in #7. But oU = conv {) {Ux |K € #}; 
hence oU is in ¥. 


Lemma I, Let X bea vector space over K and let # be a family of 
absorbing, balanced, convex subsets of X that has properties (i), (ii), 
and (iii) stated above. Then there is a unique Hausdorff, locally convex 
topology on X that has / as a fundamental system of neighborhoods 
of zero. 


Proof. For each U € ¥ let py be the gauge function of U (Section 
4.2). By (iii) the family {py |U € %} satisfies the separation condition 
(Section 4.1, Lemma 2), and so the topology defined on X by this 
family is Hausdorff. It is also locally convex. The construction process 
(Section 4.1) together with properties (i) and (ii) show that ” is a 
fundamental system of neighborhoods of zero for this topology. 

Finally, any two locally convex topologies on X that both have W 
as a fundamental system of neighborhoods of zero must coincide (Sec- 
tion 4.3, paragraph after Definition 1). 


Remark. Recall the family of sets 4” defined on the space C@(Q) 
above. There is a unique, Hausdorff, locally convex topology t* on this 
space that has 4 as a fundamental system of neighborhoods of zero. 
The space Cg (Q) together with the topology ¢* will be called the space 
of test functions in Q. The space C¢ ()[t*] will be denoted by 7(Q). 
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Definition 1. A continuous, linear functional on YQ) will be 
called a distribution in Q. The set of all distributions in Q (i.e., the dual 
of &(Q)) will be denoted by F'(Q). 


We shall show later on that this terminology is consistent with that 
of Section 3, Definition 2. Right now we are going to examine ?¢* in 
some detail and establish some of its properties. The main result is a 
very useful necessary and sufficient condition for a linear functional on 
CF (Q) to be a distribution in Q. 


Lemma 2. For each K « # let jx, be the inclusion map from 
PDx(Q) ty] into CF (Q). Then t* is the strongest locally convex topology 
on Cg(Q) for which each of the maps jx is continuous. 


Proof. If U is any t*-neighborhood of zero in Z(Q), then U con- 
tains a set of the form conv |) {U,x|K € #}, where each Ux is a 
tx-neighborhood of zero in Z,(Q). Since jx '(U) > Ux, it is clear that 
each jx is continuous when C@(Q) has the topology t*. 

Let ¢ be any locally convex topology on C§(Q) for which each of 
the maps j, is continuous, and let U be any absorbing, balanced, 
convex, f-neighborhood of zero. For each K € ¥ define U, to be 
ix '(U) = U © &x(Q). Since jx is linear and continuous, each Ux is an 
absorbing, balanced, convex, t,x-neighborhood of zero in Z,(Q). But 
clearly U->conv |) {Ux|Ke#}. Since the latter set is a 
t*-neighborhood of zero, t is weaker than t*. 


Corollary. Let G[s] be any locally convex space and let g be a 
linear map from YQ) into G[s]. Then g is continuous iff each of the 
maps g o jx is continuous. 


Proof. Let W be an absorbing, balanced, convex, s-neighborhood 
of zero in G and assume that each of the maps g ° jx is Continuous. 
Then (9° jx) '(W) = ix ‘Ig \(W)] = 9 '(W) 0 Dq(Q) is a tk-neigh- 
borhood of zero in Zx(Q), for every K € H. Since g is also linear, each 
of these sets is absorbing, balanced and convex. Clearly, g°'(W) > 
conv |} {g7'(W) A Fx(Q)|K € #} and, since the latter set is a 
t*-neighborhood of zero, g is continuous. 


We can use this corollary to prove that a continuous, linear func- 
tional on Y(R")[tg] (Section 2, before Theorem 2) is a distribution in R” 
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in the sense of Definition 1. We have maps jx from %,(R") into %(R"), 
for each K, and we have an inclusion map | from “(R") into “(R"). 
We shall show that / is continuous by showing that each of the maps 
I jx is continuous. If a compact set K, an integer k, and a multi-index 
s are given, we first let M = max{(1 + |x|?)‘|x © K} and we note that 


max{|(1 + |x|?)D°f(x)| |x € K! <M max{|D*f(x)| |x € K} 


for any f € “x(R"). It follows from this that / is a continuous, linear 
map from ‘“%(R") into “(R")[t,]. Now the map /*, defined by 
1*(S)=S 1 for every S € ¥'(R"), clearly maps #’(R") into %'(R"). 
But, since [(%(R")) is ty-dense in “(R") (Section 2, Theorem 2) this 
map must be one-to-one. 


Before proving our main result of this section we must establish the 
following lemma. The reader may want to recall the definition of a 
bounded subset of a locally convex space (Section 4.3, Definition 3). 


Lemma 3. Let X[t], Y[s] be two locally convex spaces over the 
same field, and let T be a linear map from X into Y. Assume that the 
topology t is metrizable. Then the map T is continuous iff the set 
T(B) = {T(x)|x € B} is s-bounded in Y whenever B is t-bounded in X. 


Proof. If T is continuous then, since it is linear, it must map 
bounded sets to bounded sets (Exercises 4.3, problem 3c). Assume that 
T satisfies our condition, let U be a balanced, convex, s-neighborhood 
of zero in Y, and observe that T~ '(U) is a balanced, convex subset of 
X that absorbs all bounded sets (i.e., if B < X is a t-bounded set, then 
for some ¢ > 0, Bc o[T~ '(U)]). 

Let {U,! be a countable fundamental! system of t-neighborhoods of 
zero and assume that U, > U,,, for all n. If T~'(U) is not a t- 
neighborhood of zero in X, then, for each n, we can choose x, € n-'U, 
such that x, ¢ T~'(U). Clearly the sequence {nx,} is t-convergent to 
zero and so it is a t-bounded set. But then {nx,! <a@T~ '(U), which 
implies that x, € (¢/n)T~'(U) < T '(U) for all n>o. This is a 
contradiction. 


Theorem 1. A linear functional T on Cy(Q) is a distribution in Q 
iff: To every compact subset K of Q there corresponds a constant C 
and an integer k such that | T(@)| < C sup{|D*@(x)| |x € K, |s| <k} 
for all 6 € %,(Q). 
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Proof. It is clear (Exercises 1, problem 1) that our condition on T 
can be restated as follows: To every compact subset K of Q there 
corresponds a constant C and an integer k such that | T(®)| < Cp,() 
for all @ € A,(Q). 

To prove this theorem we shall use the Corollary to Lemma 2. If 
T € &(Q) then each of the maps T > jx is continuous; ie. T« jx i8 a 
continuous, linear functional on %(Q)[t,]. It follows that there is a 
constant C and an integer k such that |T > jx(@)| < Cp,(@) for all 
o € &,(Q). Thus any distribution in Q satisfies our condition. 

Now assume that the linear functional T satisfies our condition. 
Let B be any t,x-bounded subset of %,(Q). Since p,(B) is a bounded set 
for each k (Exercises 4.3, problem 3a) our condition implies that 
T » jx(B) is bounded set of complex numbers. It follows from Lemma 3 
that T > jx is a continuous, linear functional on “,(Q)[t,]. But since 
this is true for every compact set K in Q the Corollary to Lemma 2 
shows that T € #'(Q). 


Theorem 2. A linear functional u on “(Q) is a distribution in Q iff 
lim u(;) = 0 for any sequence {@,j of points of %(Q) that has the two 
following properties: 


(i) There is a compact set K < Q such that supp @, < K for all j. 
(ii) For any multi-index s the sequence {D*p,(x)} converges to 
zero uniformly over K. 


Proof. Condition (i) says that the sequence {@,} is a sequence of 
points of %,(Q). Condition (ii) says that {@;} tends to zero for the 
topology of %,(Q). Now recall the Corollary to Lemma 2, which says 
that u is continuous on (Q) iffu » j, is continuous on %,(Q) for every 
K; here j, is the natural inclusion map from “%,(Q) into G(Q). Since 
each &x(Q) is a metrizable, locally convex space, u » jx is continuous iff 
lim u » jx(%;) = 0 whenever {@,' is a Sequence in /,(Q) that converges 
to zero for the topology of this space, i.e., whenever {@,} is a sequence 
in &x(Q) that satisfies condition (ii). This proves the theorem. 


EXERCISES 4 


1. Define a sequence of compact subsets of Q as follows: Let 
Ky = @ and, for k > 1, let K, = {x € R"| the distance from x to 
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R" ~Q is >1/k, and the distance from x to zero is <k}. Show 
that K, is contained in the interior of K,,, for k = 0, 1, ... and 
that Q) = mo K,,. 


Consider the space C*(Q). For each compact subset K of Q and 
each nonnegative integer m define p, ,(f) to be 
sup{ | D'f(x)| |x € K, |s| <m} for each fin this space. 

*(a) Show that each p,_,, is aseminorm on C”(Q) and that the 
family of all such seminorms satisfies the separation condi- 
tion (Section 4.1, Lemma 2). 

#(b) Let tp be the Hausdorff, locally convex topology defined on 
C*(Q) by the family {px ,,|K € #,m=0, 1, 2, ...}. Show 
that fo is metrizable. Hint: Use problem 1 above. 

(c) Show that C%(Q)[to] is a Fréchet space. 


(a) Let {f,! be a Cauchy sequence in %(Q); i.e., for every contin- 
uous seminorm p on this space, lim p(f, —f,) =0 as m, 
n— oo. Show that there is a compact subset K of Q such that 
supp f, < K for all n. Hint: Suppose that there is a sequence 
{x,} in Q that has no accumulation point, and a subsequence 
{fj of {f,} such that f,(x,) #0 for every k. Let {K,} be an 
increasing sequence of compact subsets of Q whose union is 
Q, and that satisfies: Ko = @, x, € K, ~ K,—,; forallk > 1. 
Define p(f) to be 2 Sy. , sup{ f(x)/f,(xx)|x © Ky ~ Ki—it- 
Finally, show that p is a continuous seminorm on @(Q) but 
P(f, — Sm) does not tend to zero as m, n> 00. 

(b) Use (a) to show that a sequence { f,} of points of (Q) con- 
verges to f € Y(Q) iff: (i) There is a compact subset K of Q 
such that supp f, < K for all n. (ii) For any multi-index s, 
{D°f,(x)} converges to D‘f(x) uniformly over K. 


(a) We refer to the sequence of compact sets {K,} defined in 
problem 1 above. Let Y,(Q) = {fe CP(Q)| supp fc K,} 
and let t, be the usual topology on this space. If K is any 
compact subset of Q and if K c K, show that the restriction 
of t, to Dx(Q) coincides with ¢,. In particular, 
thai | FAQ) = t, for all k. 

(b) For each k we have an inclusion map j, from Z,(Q)[t,] into 
CF (Q). Let t** be the strongest locally convex topology on 
C§(Q) for which each of these maps is continuous. Show 
that 1** = r*. 

(c) If K is any compact subset of Q show that the restriction of 
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(e) 


t* = t** to Y,(Q) coincides with t,. Hint: It suffices to 
show that 1*|9%,(Q)=t, for every k. Fix k and let 
Ve = {fe D,(Q)|Paw(d) < & for 1 <i <n}. Then for any p 
let Yep = {FE Dus (Q)| Pal) < & for 1 <i <n}, and let 
V=(Je1Ve,- Note that 

Va Dy + p(Q) = Vics ps Vn D(Q) = Yes 
and, if 
l<k, Van B(Q)=[Vn &Q)] A GQ) = Vi, ZAQ). 
Finally, note that V is a t*-neighborhood of zero. 
For any compact subset K of Q show that the space 9(Q)[tx] 
is a closed, linear subspace of Z(Q). 
Show that the topology t* is not metrizable. Hint: First 
observe (see problem 3) that if t* were metrizable then @(Q) 
would be a Fréchet space. Since YQ) = 21 F,(Q) and 


since each Y,(Q) is closed in Z(Q) (by (d)), our claim follows 
from the Baire category theorem. 


5. Distributions: Examples, Properties, 
and Applications 


Here we shall establish the principal properties of distributions and 
present some examples. We shall use the characterization given in 
Theorem | of the last section as our starting point. Recall: A linear 
functional T on C§(Q) is a distribution in Q iff to every compact subset 
K of Q there corresponds a constant C and an integer k such that 
| T(p)| < C sup{|D*(x)| |x € K, |s| <k} for all @ € D,(Q). 


(a) Examples. (i) A function fin Q is said to be locally integrable if 
for every compact subset K of Q, [ | f(x)| dx < co (the integration is 
over the set K). For any such function f define T,(o) = | f(x)@(x) dx 
for all @ € Z(Q). Then T; is a distribution in Q. 


Proof. For any compact subset K of Q we have 


|T(?)| 


< J [P0091 460] de < [fst a] sup] 60) x © k) 
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for all ¢ € “x(Q). So T;, satisfies our criterion for a distribution in Q 
where C = fx | f(x)| dx and k = 1. 


(ii) We recall that a G-delta in Q is any subset of Q that is the 
intersection of a countable family of open sets, and that a o-ring is a 
family of sets that is closed under complements and countable unions. 
The Baire sets in Q are the elements of the smallest o-ring that contains 
every compact G-delta. If j is a complex-valued measure on the Baire 
sets in Q such that |4|(K) < oo for every compact set K, then the 
functional T, on Y(Q), defined by T,(p) = f (x) du(x) for every 


H 


og € “(Q), is a distribution in Q. 


Proof. For any compact subset K of Q and any @ € %,(Q) we 
have 


< | [(e)| d(x) < |a|(K) supt| d(x)| |x € K}. 
So T,, satisfies our criterion for C = |u|(K) and k = 1. 


(ili)For any fixed point a € Q define 6, on the Baire sets of Q as 
follows: 6,(A) = 0 if a @ A, 6,(A) = | if.a € A. By (ii) 6, defines a dis- 
tribution in Q, which we shall denote by T,. We call T, the Dirac 
distribution at the point a. 


(b) Multiplication. For any T € 7(Q) and any f € C%(Q) we can 
define a linear functional S on Cg (Q) by letting S(¢) = T(f@) for all d 
in this space. We claim that any such S is a distribution in Q. 

Proof. Let K be a compact subset of Q, let C and k be such that 


| T(p)| < C sup{|D°@(x)| |x € K, |s| <k} for all 6 € %,(Q). Recall 
that, for any two multi-indices j = (j;, j2, ..-,J,) and q = (41, ---, Qn), 


1 2 n 


(‘,) = jil/ai'Uii — 9)! 


We also recall the Leibnitz formula D/( fd) = ¥,<; (/,)D4{D?~ 4, and 


where 
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we let M = sup{|D*f(x)| |x € K, |s| < kt}. It follows that 


Drelx)| <M ¥ (! \ipex) 


<M supl (Dai Ixe K, Li sk) E (/)} 


q<ij 
Thus 
|S(p)| < C sup{|D’(x)| |x © K, |j| <4}, 
where C = M max{)y<; (7,)| || <A}. 


(c) Differentiation. If f, ¢ are in Cy((0, 1)) then, using integration 
by parts, we find that { f’(x)o(x) dx = —J f(x)'(x) dx. So if dT/dx 
denotes the distribution defined by f’(x) (as in (a), example (i)), then we 
have dT/dx(@) = — T;(¢’) for all $. This observation motivates the 
following: 


Definition 1. Let T be any distribution in Q. We define D‘T as 
follows: D*T(¢) = (— 1)8!T(Ds@) for all @ € Z(Q). 


We must show that D°T € '(Q). However, for any compact subset 
K of Q we have C and k such that | T(p)| < C sup{|D’@(x)| |x € K, 
|r| <k} for all ¢ € %,(Q), and clearly D‘T must satisfy a similar 
inequality. 

If Q=R and H(x)=1 for x >Oand =0 for x <0, then clearly 
dTy/dx(p) = —J H(x)o'(x) dx = — JF $'(x) dx = $(0) = Tol), where 
To is the Dirac distribution at zero. So the distributions dT,,/dx 
and 7, are equal. 


Definition 2. Let U be an open subset of Q. There is an inclusion 
map | from <(U) into @(Q) that is clearly continuous. Hence /*, where 
I*(T) = T © I for all T € @(Q), maps 7(Q) into Y(U). If T € #(Q), 
we shall call T- J the restriction of T to U. We shall say that S, 
T € &(Q) are equal in U if their restrictions to U are equal. 


Theorem 1. Let @ be an open subset of R” whose closure is 
compact, and suppose that this closure is contained in Q. Then for any 
T € 7'(Q) there is an f € L,,(w) and an integer m such that the distribu- 
tions T and DT D}D3 --- Dif are equal in w; here D7 = 0"/Ox7". 
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Proof. Given T € (Q) we seek a function fe L,,(@) such that, 
for any eC §(w), we have: (1) T(?)=(D7--: Dif)o= 
(—1)"" J f(x)[DT --- Dtb(x)] dx. If we had such a function fand if we 
let C = ||f||,,, then (1) would yield: (2) 


[T(¢)| <¢ | [DT Dtg(x)| dx 


for all @ € CE (a). 
Now suppose that we have a distribution S in Q that satisfies (2) for 
some constant C and some integer m. Clearly 


(= L)™"DT --- Di'd(x)|@ € CF (e)} 


is a linear subspace of L,(w), and inequality (2) says that the map that 
takes (—1)""DT --- D"@(x) to S(@) is continuous on this subspace for 
the L,-norm. By the Hahn-Banach theorem we can extend this map to 
a continuous, linear functional on all of L,(@), whose norm is <C. 
But since L,,(@) is the dual of L,(@) this means that there is a function 
fe L,(@) that satisfies (1), and for which || f ||, < C. 

The argument up to this point shows that, to prove the theorem, it 
suffices to show that any T € %’(Q) satisfies (2) for some constant C 
and some integer m. Now the closure of @, cl w, is compact, and so 
there is a constant C and an integer k such that |T(@)| < 
C sup{ | D*¢(x)| |x € cl @, |s| <k} forall d € Zy,(Q). Let € CF(w) 
and, for fixed j, let a, be the upper bound for 
{|x,| |x = (x1, .--. X,) € @}. By the mean value theorem sup |(x)| < 
a, sup|D,(x)| for all such y and, by repeated use of this estimate we 
obtain: (3) | 7(@)| <C’ sup|D{ --- Di o(x)|. For any @ € C@(@) we 
can write o(x) = (—1)" J D, --- D,@(x) dx, where the integration is 
over the set y<x, Le, yy <X4, Yr <X25 +005 Va <Xn- SO (4) 
sup| (x) | < C’ fsup|D, --- D, @(x)| dx. From (3) and (4) we get (2) 
with m=k + 1. 


Our next result relates the derivative of a distribution that is 
defined by a function to the classical derivative of that function. We 
recall the nonnegative, C“-function @ whose support is the unit ball of 
R", which is positive in the interior of that ball, and satisfies 
J w(x) dx = 1 (Section 1, before Lemma 1). 


Theorem 2. Let g, fbe two continuous functions in Q and suppose 
that, as distributions, D;g = f (here D; = 6/0x,), ie., D; T,(6) = T,() 
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for all @ € AQ). Then D;g exists in the classical sense and is equal to 
the function f(x). 


Proof. We want to prove that D,g exists at each point x € Q and 
is equal to f(x). By making suitable use of a function in C¢’(Q) that is 
one on a neighborhood of x we see that we may assume that both g 
and f have compact support in Q. 

For any ¢>0 let g,(x)=e°" { g(y)ol[(x — ye] dy. We have 
already seen that g,(x) € Cg(Q) and that it tends to g(x) uniformly in Q 
as € tends to zero (Section 1, proof of Lemma 1). Now 


Djgdx) = 6°" | aly Dyol*—" Jay =e" | gly) (5?) dy 


seg 0. {x= y a 
=-6 { aly) (5 jase D,T, 


eles") 


by hypothesis. This last term is e~" J f(y)o[(x — y)/e] dy = f(x). Thus 
D,g,(x) tends to f(x) uniformly over Q as ¢ tends to zero. It follows that 
D, g(x) exists and that it is equal to f(x). 


(d) Support. If fis a continuous function in Q we have defined the 
support of f, supp f, to be the closure of {x € Q| f(x) #0}. We are 
going to define the support of a distribution in Q in such a way that, in 
particular, the support of T, coincides with supp f- 

We shall say that a distribution T in Q vanishes on the open subset 
U of Q if the restriction of T to U (see Definition 2 above) is zero. 


Lemma I. If a distribution in Q vanishes on each member of a 
family of open sets, then it vanishes on the union of this family. 


Proof. Let {U,|veJ} be a family of open subsets of Q, let 
T € @(Q), and assume that T vanishes on U, for each ve J. We 
construct an open covering of Q as follows: Choose y ¢ J, let U be the 
union of the family {U,|v € J}, choose ¢ € YQ) with supp gc U, 
and set U, = Q ~ supp @. Then, setting 1 = J U {yu}, we have a cover- 
ing {U,|v eT} of Q. 

There is a C*-partition of unity {a,|v © 7} that is subordinate to 
this covering (Section 1, Theorem 2). Clearly, @ = ¥° {a,@|v € J} and 
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so T(¢?) => {T(a,¢)|v el}. Now if veJ, then T(a,¢)=0 by 
hypothesis. Also, since supp a, < U,, = Q ~ supp ¢, a, ¢ =0 and so 
T(x, @) = 0. Thus T(@) = 0 for every @ € Y(U) and this says T van- 
ishes on U. 


Definition 3. For each T € %(Q) consider the family of all open 
subsets W of Q such that T vanishes on W. Let U be the union of this 
family. Then we define the support of T, supp T, to be the set Q ~ U. 


Suppose that f is a real-valued, continuous function in Q and let x 
be any point at which f is not zero. Then for any neighborhood U of x 
there is a neighborhood V of x such that V c U and f is of constant 
sign on V. Choose one more open neighborhood (call it W) of x in such 
a way that, denoting the closure of W by cl W, cl W c V. There is a 
function @ € AQ) (Section 1, Corollary to Theorem 2) such that: 
0 < d(y) <1 for all ye Q; O(z)=1 for all zecl W; O(y) =0 for 
y¢V. Then T,(d) = § f(y)O(y) dy #0 and so x e supp T,; ie. we 
have shown that supp fc supp T;. 

Now suppose that z ¢ supp f. Choose any neighborhood of z that is 
disjoint from supp f and notice that T,(@)=0 for all functions @ 
whose support is in this neighborhood of z. Thus z ¢ supp T;. So the 
support of the function f coincides with the support of the distribution 
T,. 

: We leave it to the reader to compute supp T, when f is a complex- 
valued, continuous function in Q. 

The next theorem requires that we recall the topology tp defined on 

C*(Q) (Exercises 4, problem 2b). 


Theorem 3. The dual of the locally convex space C*®(Q)[to] is 
isomorphic to the space of all distributions that have compact support 
inQ. 


Proof. Let S bea linear functional on C*(Q) that is tg-continuous 
on this space. It is convenient to give the proof in steps. 

(i) Corresponding to the given linear functional S there is a com- 
pact subset K of Q, a nonnegative integer m, and a constant C such 
that: 


(*)|S(f)| < C sup{|D¥f(x)||x eK, |s| <m} forall fe C*(Q). 
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Since S is to-continuous there is a fo-neighborhood (call it V) of 
zero in C”(Q) and a constant C such that |S(f)| <C forallfe V. We 
may assume, because of the definition of to, that there is a compact 
subset K of Q and a nonnegative integer m such that 
V={feC*Q)|px.wlf) < Ul. Condition (*) is equivalent to 
IS(f)| < Cpx.m(S) for all fe C*(Q). 

If px.»(f) = 0, then the same is true of of for any scalar a; ic., 
of € V for all x. But then |S(af)| < C for all « implies S(f) = 0. Thus 
(«) is true for any f for which px ,,(f) = 0. 

Now suppose px. »(f) #0. Then f/px. »(f) is in Vand so |S(f)| < 


CPx. m(J) for any such f. 

(ii) Here we shall define a one-to-one, linear map y from the dual of 
C*(Q)to] into F'(Q). 

To the given functional S we have associated a compact set K 
(condition («) above). Choose, and fix, y € Cg(Q) such that p(x) = 1 
for all x in some open set containing K (Section 1, Corollary to 
Theorem 2). For any fe C%(Q), f=fw + (l—w)f and so S(f)= 
S(f) + S[(1 — w)f]. Since (1 — w)f is zero in a neighborhood of K, 
condition («) tells us that S vanishes at this function. So we have shown 
that S(f) = S( fw) for all fe C%(Q). 

Now regard S as a linear functional on Cg (Q). We recall the inclu- 
sion maps jx from &%,(Q) into Cg (Q) and we also recall that to prove 
that S is continuous on &(Q) it suffices to show that, for any K, Sojx(B) 
is a bounded set whenever B < %x(Q) is bounded (Section 4, Corollary 
to Lemma 2, and Lemma 3). If B is a bounded subset of %,(Q) then 
{Wo| € jx(B)} is to-bounded in C%(Q)—this follows immediately 
from the way the seminorms defining fo are defined. But since S is 
fo-continuous on C%*(Q), the set {S(Wo)|@ € jx(B)} is bounded. 
However, {S(W)|@ € jx(B)} = (S()|@ € jx(B)} by the paragraph 
above. Thus S o j, is continuous for any K and so S defines a distribu- 
tion y(S) in Q. 

Clearly y is a linear map from the dual of C*(Q)[to] into ’(Q). Let 
us show that y is one-to-one. If S, T are in this dual space then so is 
S — T. By the first paragraph of the proof of (ii) we can choose 
Ww € Cg (Q) such that (S — T) f= (S — T)bf for all fe C*(Q). I y(S) = 
y(T), then y(S)Wf = y(T)Uf because wf € (Q). But then (S — T)f=0 
for all fe C*(Q) and so S = T. 

(ili) We will now show that »(S) has compact support. 

Recall the compact set K associated with S$ (condition (*)) and that 
S(f) = S(Wf) for all fe C°(Q), where y is any C@-function that is one 
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on a neighborhood of K. If @ € Cg(Q) and supp @ m K = @, then we 
can choose w € Cg(Q) such that y is one on a neighborhood of K, but 
y is zero on supp @. It follows that (S)¢ = 0 and, since this is true of 
every @ with supp @ 4 K = @, supp 7(S) c K. 

(iv) The only thing left to prove is that y is onto. 

Let Sp € %(Q) and let K = supp So be compact. We define a linear 
functional § on C%(Q) as follows: Let y be a fixed C%-function that is 
one on a neighborhood of K, and set S(f) = So(vf ) for all fe C%(Q). 
Let B be any to-bounded subset of C*(Q) and note that {Wf | fe B} isa 
bounded subset of %(Q). Since Sp € 7'(Q) and {S(f)| fe B} = 
{So(wf)| f € B}, this set is bounded. It follows that S is to-continuous 
on C*(Q) (Exercises 4, problem 2b, and Section 4, Lemma 3). To prove 
that y is onto we need only observe that, by the third paragraph of (iii), 
(S) = So. 


(e) Convolution, There does not seem to be any really simple way 
of treating this topic. However, the usefulness of the convolution oper- 
ation fully justifies the efforts made to define and study it. 

If.f, g are C%-functions on R and if g has compact support, then the 
convolution of f and g, f * g, is defined as follows: 


feats) =| fle — yar) dv = | fae =») dy. 


Observe that, because of our assumptions on f and g, f * g is well 
defined, f * g(x) = g « f(x) for all x, and f « g(x) = T,[g(x — y)], where 
the distribution T, is applied to the function g(x — 5) of )'; here x is 
fixed. With this as motivation we can define the convolution of a 
function and a distribution in two important cases. 


Definition 4. Let @ € “(R"), ue 7 (R"). We define the convolu- 
tion of u and @ at x, u * d(x), to be u[@(x — y)]. We will sometimes 
write u « o(x) = u,[o(x — y)], where the notation is meant to empha- 
size the fact that we are applying the distribution u to the function 
o(x ~— y) of y; x is fixed. 

If @ € C*(R") and the distribution u has compact support in R", 
then we define u * (x) to be u,[¢(x — 1)]. This has meaning (Section 
5, Theorem 3). 


From the definition of the support of a distribution it is immediate 
that u * o(x) = 0 unless the support of u meets the support of @(x — y) 
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(as a function of y); ie., u * d(x) =0 unless there is a y € supp u such 
that x — y e supp @. Thus 


supp u « @ c supp u + supp ¢. 


In particular, if both u and @ have compact support, then so does 


ux. 


Lemma 2. If @¢ 4(R") and ue Y(R"), then u * de C”(R"). 
Also, for any multi-index s, D’(u * @) = (D’u) * ¢ =u * (D‘d). The 
same conclusions hold if the function @ is in C*(R") and the distribu- 
tion u has compact support. 


Proof. Let @ € A(R") and let {x/} be a sequence of points of R” 
that converges to the point x. Then the C%-functions $y) = 
o(x/ — y), j= 1, 2, 3, ..., converge to the C®-function @o(y) = 
g(x — y) in the following manner: (i) There is a compact set K such 
that supp $; < K for all j. (ii) The sequence {D*d,} converges to D°do 
uniformly over K, for any multi-index s. Hence (Section 4, Theorem 2), 
lim u(d;) =u(do) for every ue G(R"), But this says that 
lim u « $(x/) = u * $(x); Le., u * @ is a continuous function. 

In order to prove that u + @ € C%(R") it suffices to prove the differ- 
entiation formulas stated in the hypothesis. First let s be a multi-index 
such that |s| = 1, and let e, be a unit vector along the positive x, axis 
of R". Now 


lu «G(x + he) —u# @(x)Jhr! 
= u,l{b(x + hey — y) — $x — y)}h7#. 


If, in this equation, we let h run through a sequence converging to zero, 
then the quantity in square brackets will converge to 0¢(x — y)/éx, in 
the manner described in (i) and (ii) above, Since h can run through any 
sequence converging to zero and the conclusion still holds, and since 
ue @(R"), the right-hand side of our equation converges to 
u x (0@/0x,) as h tends to zero. Hence the left-hand side of our equa- 
tion also converges as fh tends to zero, and clearly its limit is 
O(u * b)/Ox,. The proof can now be completed by induction. 

Sou*x@eC® and Diu * ¢)=u * D*¢ for all s. The fact that 
D'u * @ =u * D’¢ follows from the definitions. 

In case the function @ is in C*(R") and the distribution u has 
compact support the proof above goes through almost without change. 
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Corollary 1. Let u € &'(R") and, for each @ € &R"), let U(d) = 
u * @. The map U, from &(R") to C*(R"), has the following property: 
If {;} is a sequence of points of Z(R") that converges, for the topology 
of ZR"), to Go, then lim U(¢;) = U(@o) for the topology of C%(R"). 

If @ € C*(R") and the distribution u has compact support, then the 
map U, U(¢) = u « ¢, from C%(R") to C%(R") is continuous. 


Lemma 3. Let ¢, y be two C®-functions on R", let u be a distribu- 
tion in R", and assume that any two of these three objects have com- 
pact support. Then (u + @) « ~=u * (od * W). 


Proof. Recall that @ * y(x) = J o(x — y)W(y) dy, and since these 
functions are in C®(R") we can approximate the integral by a Riemann 
sum, say &") p(x — eg)W(eg) =f,(x), where ¢ > 0 is fixed and g runs 
through all points with integer coordinates. Observe that f,(x) is a 
C®-function of x. Now for any multi-index s, D*f,(x)= 
&" Y D'o(x — eghb(eg), and this converges to (D*d « W)(x) = 
[D‘(p * w)](x) uniformly as ¢ goes to zero. It follows that the sequence 
{f.(x) |e = I/n, n= 1, 2, 3, ...} converges to @ * wy for the topology of 
C~(R") if only one of the functions ¢, y has compact support, and that 
it converges to @ « w for the topology of &(R") if both of these func- 
tions have compact support. Hence u « (@ * w) = lim u * f, in either 
case (Corollary 1 above). Thus ‘ * a « w)\(x) = lim u * f(x) = 
lim e” ¥° (u « o)(x — eg)p(eg) = [(u * b) * W}(x) for all x. 


We have already seen (see (a), example (i)) that C@(R") < Y’(R"). 
Let us use Lemmas 2 and 3 to characterize the closure of this subspace. 


Theorem 4. The vector space C%(R") is weak* dense in %'(R"); 
ie., it is dense in %'(R") for the topology o(9’(R"), Z(R")). 


Proof. Choose w € C3(R") with w > 0, 
supp @ = {x € R"| |x| <1} 


and { w(x) dx = 1. For ¢>0 let w,(x) be e~"w(x/e) and note that 
u*@, is | C*(R") for every u € Y(R") (Lemma 2). Hence, to prove 
the theorem, all we need do is show that u * w,(y) converges a u(y), as 
é tends to zero, for all y € G(R"). If y € A(R"), then (x) = Y(—x) for 
all x is also in Q(R"), and u(y) =(u*W)(0) since 8 + W)(0) 
= u,[¥(0 — y)] =u,[W(y)]. Thus what we must show is that 
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u « w,(x) = [(u + w,) « U}(O) tends to u(y). But, by Lemma 3, the left- 
hand side is equal to [u * (w, * %)}(0) and, since w, * Y converges to p, 
we are done. 


For any fixed distribution u we can define a map U as follows: 
U(@) = u « ¢ (see Corollary | to Lemma 2). It is clear that U is linear 
and we have already seen that it maps a convergent sequence onto a 
convergent sequence. This map has one more important property. For 
any fixed he R" let t, (x) = (x — h) for every ¢ € C*(R"). Then 
t,(u x d)(x) =u * O(x — h) = u(x — h— y)}, and 


[u « (ca )]l) = uylta (x — vy) = wlO(x — y — hy} 


Hence u + t,@ =1,(u * ) and it follows that t, U(@) = U(t, @); ie, U 
commutes with translation. 


Lemma 4. Let U be a linear map from 9(R") into C%(R") that 
commutes with translation and maps convergent sequences onto con- 
vergent sequences. Then there is a unique distribution u in R" such that 
U(d) = u « ¢ for all @ € F(R"). 

If U is a continuous, linear map from C%*(R") into C%(R") that 
commutes with translation, then there is a unique distribution u, with 
compact support in R", such that U(@) = u « @ for all @ € C%(R"). 


Proof. For each ¢ € A(R") let (x) = ¢(—x) for all x. The map 
that takes d to U()(0) is a linear functional on @(R"). Let us assume, 
for the moment, that this map is a distribution (call it u) in R". Then 
U( pO) = wi) and so u + $0) = u[4(0 — y)] = uLFy)] = U(P)O); 
Le., the equation u *« d(x) = U(p)(x) holds when x = 0. But U(t_,, 6)(0) 
= (u * t-4)(0) = t-,[U(@)(0)] = t-slu * $)]; ic, 


U()(h) = u * oh) 


for all h. 

If U is a continuous, linear map from C*(R") to C*(R"), then the 
map that takes each @ (@ € C“(R")) to the number U(@)(0) is clearly a 
continuous, linear functional on C*(R"). Thus this map is a distribu- 
tion with compact support in R" (Section 5, Theorem 3). The remain- 
der of the proof is the same as that given for the case above. 

We shall now show that the distribution u defined, as above, by the 
map U is unique. Suppose that there is another distribution v such that 
U(¢) = v * ¢ for all @ € A(R"). Recall the C%-function q@ that is non- 
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negative, has for its support the unit ball in R", and satisfies 
J w(x) dx = 1. For ¢ > 0 define w,(x) to be &~ "w(x/e) and recall that 
u «x w,(~) converges to u(d) for every @ € A(R") (see the proof of 
Theorem 4). Thus if u + w, =v *« w, for all e > 0, then u= v, 


Let u,, u, be two distributions in R". Suppose that uz has compact 
support. Then u,+*@e(R") for every ge A(R"), and so 
u, * (u. * @) has meaning and is in C*(R") (see the paragraph after 
Definition 4, and use Lemma 2). The map that takes each @ € (R") to 
u, * (uz * @) is linear, sequentially continuous (Corollary | to Lemma 
2), and translation invariant (paragraph before Lemma 4). Hence, by 
Lemma 4, there is a unique distribution ww such _ that 
u, * (u, * d) =u * @ for every d € Y(R"). 

Similarly, if u, has compact support (but u, need not), then u, « @ 
is in C*(R") and so u, * (u, * @) has meaning and is in C%(R") also, 
Again, there is a distribution u, which is unique, such that 
u, * (u, * 6) =u * @ for all ¢. 


Definition 5. Let u,, u, be two distributions in R" and assume that 
at least one of them has compact support. Then u, * u is defined to be 
the unique distribution wu that satisfies u, * (u. « d) =u * @ for all 
pe V(R"). 


Note that, by definition, (u, * u.) * @ = uy, * (uz * @). Ifuy, un, U3 
are in &’(R") and if all but one of them has compact support, then 
[(uy * U2) * U3) * P= (uy * uy) * (us * G) = Uy * [Uy * (U5 * )) 
= [uy * (u, *u3)] *¢ 
for all @ € 7(R"). So convolution is associative. 
Lemma 5. If u,, u, are in %’(R") and if at least one of these 
distributions has compact support, then u, * u, =u * uy. 
Proof: We have: 
(uy * U2) *(p * YW) =u, * [U2 * (% * W)) 
= (by Lemma 3) u, « [(u2 * ?) « WJ 
=u, *[W * (uz * )] 


(convolution of C®-functions is commutative) = (u, * W) * (uz * @). 
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Similarly, (u, *u,) * (@ * W) = (uy * W) * (u, * d). So 

(uy * U2) * (P * W) = (uz * u,) * (P * W) 
for all @, Ww in G(R") This says that [(u, *u.)* ¢]*W= 
[(u2 * uy) * db] * W for all y and, as we saw in the last paragraph of the 
proof of Lemma 4, this implies (u, * u,) « @ = (u2 * u,) * @ for all ¢. 
Using this same argument again we obtain u, * u, =u, * uy, 


Lemma 6. Let u € @'(R") and let 7) be the Dirac distribution at 
zero (see (a), example (iii)). Then D°u = (D*T,) *« u for any multi-index 
s. Also, if u,, uz € &(R") and at least one of these distributions has 
compact support, then D*(u, * u,) = (D’u,) *u, =u, * (D'u) for any 
multi-index s. 


Proof. Observe that (u * Ty) *@=u «(Th «@) =u @ for all 
o € “(R"). Hence u * T) = u and so 
(D'u) * 6 =u * (D°d) (Lemma 2) 
=[u + (D'9)] « Ty =u + [(D°9) « a =u «[$ + (D°T,)] 
+ [(D°Ty) * @) = [u * (D°T)| * @ = [(D°T) « u] +o 


for all @. It follows that D’u = (D*T)) * u and the second part of the 
lemma follows immediately from this formula. 


Let P(w) be a polynomial of degree m in the n variables w,, w3,..., 
Wa SO W = (Wy, W2,..., W,) € R". If we replace each w, by the operator 
D; = 0/6x,, we obtain a partial differential operator, of order m, with 
constant coefficients. We shall denote this operator by P(D). 

Suppose that for a given operator P(D) we have a distribution F in 
R" such that P(D)F, the operator applied to F, is equal to 7) (the Dirac 
distribution at zero), Then, if T is any distribution with compact sup- 
port in R", the equation P(D)S = T can be solved for S since P(D) 
(F + T)=[P(D)F]« T (by Lemma 6)=%*T=T and_ so 
S =F « T. The distribution F is called a fundamental solution for the 
operator P(D). 

We shall illustrate these ideas by finding a fundamental solution for 
the Laplacian in R". In order to do this we shall need the next few 
results, 
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For any fixed e>0 define ©,() to be {,,>.[6(x)/x] dx for all 
¢ € Y(R). Any such ¢ has compact support and if supp ¢ < [—a, a], 
then |®,(@)| < max{|@(x)| |x ¢[—a, a]}2 log a/e. Hence ®, € Y’(R). 

If de “(R) we may write p(x) = P(0) + x(x), where p(x) is a 
continuous function with y(0) = ¢’(0). Choose a so that @(x) = 0 for 
|x| >a, Then 


O,() = $(0) [reeadxix +f Wx) ax 


"e<(x|<a 


= $(0)(log a/e — log a/e) + { W(x) dx. 
e<{x{<a 
Thus lim, .o+ ®.(@) = 2.4 W(x) dx and we may define a linear func- 
tional ® on %(R) by setting ®(¢) equal to this limit (for each 
p € “(R)). 

Let us show that © is a distribution in R. It suffices to show that for 
every compact subset K of R the map ® » j, is continuous on %,x(R), 
where, as usual, j, denotes the natural inclusion map. Choose and fix a 
compact subset K of R, choose a sequence {e(n)} of positive numbers 
such that lim,..,, €(n) = 0, and let V be a closed, balanced neighbor- 
hood of zero in the underlying field C. We can find another closed, 
balanced neighborhood of zero (call it W) in Csuch thatW+WcV, 
Since each ®,,,, is a distribution in R, M = (\@, jx’ » Oi (W) isa 
closed, balanced subset of %,(R). Now {®,,,(¢)|n = 1, 2,...} is 
a bounded set of complex numbers because lim, ..,, Pim() exists for 
each fixed @ € Y(R). Hence there is a scalar o such that o®,,,,(@) € W 
for all n, It follows that af € M and so M is an absorbing set. Thus 
(J, nM = &,(R). But %,(R) is a Fréchet space (Exercises 2, prob- 
lem 1) and so, by the Baire category theorem, M contains an open set. 
Let U be a neighborhood of zero in %,(R) that is contained in M — M. 
We have ®.,,) © jx(u) © Pen °Jx(M — M) cW— W eV for every n. 
Hence ® : j,(U) c V and the proof is complete. 


Recall that the Laplacian is the operator V = 07/0x7 + 07/0x3 + 
*++ + 07/0x?.. We shall assume that n > 3 and we shall show that the 
following distribution is a fundamental solution for this operator: For 
each @ € %(R") let 
. |-T(n— 2/2 
(1) F(¢) = lim | (x) ix| 


nj2 
esOt 4n {x} >e r 


where r = (xj + x3 +°*> + x?)!/* and I denotes the gamma function. 
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From the definition of differentiation ((c), Definition 1) and the fact 

that 1/r"~? is a harmonic function [4, pp. 252-258] we see that 
7 2S I(n — 2/2) .. V(x) 

(2) VF(b) = F(VO) = - Goan Jim ie ee Os 
Choose | so large that the set supp @ is contained in the interior of the 
sphere, centered at zero, of radius | and let Q be the open set that is 
bounded by the spheres r = ¢ and r =]; here ¢ is a positive number 
that is less than |. If €Q denotes the boundary of Q and 6/én denotes 
differentiation in the direction of the outward normal to 6Q, then, by 
one of Green’s identities [4, pp. 252-258], we may write 


, . Ov Ou 
3 Vv — v Vu) dx = — da, 
(3) | v ~ v Vu) dx [ (u a v sa wo 
where dw is the measure on 0Q. In the case of interest here 
dw = "~! do where do is Lebesgue measure on the unit sphere (call it 
S) of R". So (3) becomes 


Vo | it MI en ae 
(4) Le, yn? a - laa V(sae3) ds ss | ¢ or (0 ) He 
= | 5H OF yo do. 


as 
The first integral on the right-hand side of (4) is zero because 1/r"~ ? is 
a harmonic function. The third integral is bounded by some constant 
times « J da, and so it tends to zero with «. To treat the second integral 
we first note that 


Or \r"™ 2 


Hence this integral becomes 


—(n~2)] G(x) do = —(n—2)|S|(1/|S|) | O(ro) do, 
where |S| denotes the surface area of S;ie., |S| = 22"*/T(n/2). Thus, 
if we take the limit, as e tends to zero, of both sides of (4) we obtain, 
using (2) and the above remarks, the equation 

—4n"/? —4n"!? 


F((n — 32) VF(b) = —(n — 2)|S|$(0) = T(n — 292) 


T(?), 
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where, as usual, JT) denotes the Dirac distribution at zero. It follows 
from this that F is a fundamental solution for the Laplacian, 

If T is any distribution with compact support in R", then a solution 
S of the equation VS = T is S = F « T.In particular, if T = T,, where f 
is a C% -function, then 


sare ta LAYS) 


Ant? 


APPENDIX A 


Solutions to Starred Problems 
in Chapters 1-4 


I have said elsewhere that the first four chapters of this text are 
introductory, If that is the case, then my practice of leaving some 
results for the student and then referring to these results later, a prac- 
tice I consider quite reasonable in the latter part of the book, can be 
legitimately criticized. An introductory chapter should contain all but 
the most routine of details. For this reason I have asked one of my 
graduate students, Andrea Blum, to write up her solutions to the 
starred problems in Chapters 1-4. 


EXERCISES 1.1 


Problem 1. By the triangle inequality |x — y + y|] < |x — y|| + 
lly; Hence |||] — |ly|]| < |x — yl] for all x, y in E. If {x,} is a se- 
quence of points of (E, ||:||) that converges to x9 € E, ||x, — Xo| 
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tends to zero as n tends to infinity. Thus | ||x, || — ||xo || | tends to zero 
also, 


Problem 2a, If we assume that u is continuous at zero and if {x,} is 
a sequence of points of E that converges to xo, then lim u(x, — xo) = 0 
because x, — Xo} converges to zero. By the linearity of u, this is equiva- 
lent to lim u(x,) = u(xo); ie. u is continuous at xq. 


Problem 2b. Assume that there is a constant M such that 
||u(x)|| <M for all x in the unit ball of E. If {x,} is any sequence of 
nonzero points of E that is convergent to zero, then |lu(x, /||x, ||)|] <M 
for all n, or |]u(x,)|| < M|lx, || for all n. Since lim||x, || = 0 we see that 
lim u(x,) = 0 in E. Thus u is continuous at zero and hence, by problem 
2a, continuous on E. 

Now assume that u is continuous on E. Suppose that for each 
positive integer n there is an x,¢€E such that ||x,|| <1 and 
||u(x,,)|| =n. Choose such an x, for n = 1, 2, 3,.... Then the sequence 
{x,,/||u(x,)||} converges to zero in (E, ||: ||). Since u(x, /|lu(x,)||) has 
norm one for each n, we have contradicted the continuity of u at zero. 
Hence there must be a number M such that |/u(x)|| < M for allx € E 
with ||x|| < 1. 

Problem 2c. If there is a constant M such that ||u(x)|| < M||x|| for 
all x € E, then clearly u is continuous at zero and hence on E. Con- 
versely, if u is continuous on E then there is an M such that 
||u(x)|| <M for all x in the unit ball of E (by problem 2b). If x is any 
element of E that is not in this ball, then x/||x|] is in the unit ball. Hence 
[u(x/|x])]] <M or u(x) < Mx] for all x € E 


EXERCISES 1.3 


Problem 2c. It is clear that co is a linear subspace of |, . Suppose 
that {x"|n = 1, 2,...} is a sequence of points of co that converges to 
xel, for the /,-norm. We want to show that xecy. Here 
x" = {xf |k = 1, 2,...} for each n and x = {x,|k = 1, 2,...}. For any 
é > 0 we can find an integer no such that ||x" — x||,, < efor alln > no; 
ie., sup{ |xf — x, | [A = 1,2,...! <¢forn > no. It follows that, for each 
fixed k, lim xf =x,. Also, if | is any integer, |x,| < |x,—x}| + 
|x?| <é+ |x?| for all n > no. Fix n > no. Then since {xf} € co for this 
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n, lim|x7| = 0 (as | goes to infinity). Hence lim sup|x,| < ¢, but since 
é > 0 is arbitrary, lim x, = 0. So we have shown that x € cy and also 
that cp is closed in (1,,, || ||.). 

We will now show that {e;|i= 1, 2,...} is a Schauder basis for 
(co, (|). Let x = {x,|n = 1, 2,...) be any element of cy. Then 
Ix — Wher XnCn lo = sup{|x,|,  [x42],.--} Since x € co this 
supremum tends to zero as | tends to infinity. So for any x € Cy we have 
found numbers {x,} such that lim||x — ))-1 Xp n|{. = 0. The unique- 
ness of these numbers is clear. 


Problem 3. The sequence {e,} is not a Hamel basis for |, because 
the element {1/n?} € 1, cannot be written as the linear combination of a 
finite number of these vectors. 


Given. x = {x be ly [xe Shey pe eS 2 yey: [els Sine 
Y= |x,| is finite, the latter sum tends to zero as / tends to infinity. So 
we have found numbers {x,} such that lim|}x — )'_, x,e, ||; = 0. It is 


clear that these numbers are unique. 


Problem 4a. Let N be a proper, linear subspace of X. Suppose 
that N is the null space of some nonzero element f of X *. Then there is 
a point Xy € X such that f (xo) = t,t # 0. Clearly f(x /t) = 1 and so we 
may assume that f(x9) = 1 to begin with. It is obvious that x) ¢ N but 
that, for any x € X, x —f(x)xo is in N. Hence for each x in X we may 
write x = [x —f(x)xo] + f(x)xo, which shows that N has codimension 
one in X, 

Now suppose that N has codimension one in X,. Then we can find 
Xo € X such that for any x € X there is a y € N and ascalar A satisfy- 
ing x = y+ Ax. Since N is proper the vector x9 cannot be in N, 
Define a map f from X into the underlying field as follows: f(y) = 0 for 
all ye N, f(xo)= 1, and f is linear, If x eX can be written 
xX=y, + A,xq and x = yz + A, Xo, where y;, y2 are in N and A,, A, are 
scalars, then y, — y, = (A, — 42)xo. But since we have already noted 
that xo ¢ N, we must conclude that 4, —A, =0 and hence that 
Vy, = yz. Sof is well defined. Clearly the null space of fcontains N. If x 
is in the null space of f, then x = y + Axo where A = O and y € N; i.e, 
xeEN. 


Problem 4b. Let N(@), N(®) denote the null spaces of 0 and 4, 
respectively. We are assuming that N(@) < N(@). The first thing we 
shall show is that N(@) = N(@). Suppose that there is a point x’ that is 
in N(@) but not in N(6). Since N(@) has codimension one in X we can 
find x9 € X such that for every x there is a y € N(O) and a scalar A for 
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which x = » + Axg. Then x’ = »’ + A'xo for some y’ € N(@) and some 
scalar 4’. Since 0(x') #0, A’ #0. But 0 = $(x’) = 4’O(xo) and hence 
(xo) must be zero. It follows that ¢ = 0 and this is a contradiction. So 
N(8) = N(9). 

2) 


If x is any element of X then x = y + Axo where y € N(0) = N( 
and 4 is a scalar. So 0(x) = AO(xo), or A = O(x)/A(xo). Then (x) = 
AG(X0) = [A(x )/P(X0)}O(X0) = [O(X0)/O(X0) A(x). Since O(x0)/A(xo) is a 
scalar we are done. 


EXERCISES 2.2 


Problem 6b. Let X be a vector space, let {f,. $2, ..., &,} be a 
finite, linearly independent subset of X*, and let @p be an element of 
X * whose null space contains (\?_, N(,); here N(@,) is the null space 
of @; for each j = 1, 2, ..., p. We claim that the set {o, 1, ..., bp} is 
linearly dependent. 

The first thing we shall establish is that the space (\?_, N(@,) has 
codimension p in X. We shall prove this by induction on p. The case 
p = 1 has already been considered (Exercises 1.3, problem 4a, solved 
above). Assume that the result is true when p=k and consider a 
linearly epee set {b,, 2, ..., Oy, 1} containing k + 1 elements. 
Let:N, =f \jei N(@;) and note that, by the inductive hypothesis, N, 
has godinension k in X. Consider the restriction of @,,, to N,; call it 
4 1- We distinguish two cases: (i) N(@,41) > N, so that 4, = 0; 
(ii) N(Oys 1) = N(Oy41) O Ny is a proper, linear subspace of N,. 

Case (i). It is clear that in this case @,,, € (X/N,)*. Now X/N, 
has dimension & and, since k is finite, (X/N,)* also has dimension k. 
But {@, $2, ..., @, is a linearly independent subset of (X/N,)* that 
contains k elements. Thus ¢,,, is a linear combination of these ele- 
ments and we have contradicted the linear independence of the set {@,, 
2, ---> Des ys 1}. SO case (i) cannot arise. 

Case (ii). We have already observed that N, has codimension & in 
X. This means that there is a k-dimensional subspace X, of X such that 
X = N,@X,,. Hence given any point x € X there are unique elements 
yeN,,z€X, such that x = y + z. Now by Exercises 1.3, problem 4a 
(solved above), the space N(,, ;) has codimension one in N, . So there 
is an element x’e N,, x’ ¢ N(@i,4,), such that N, = N(o,41)® 
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lin{x’}. The element y, mentioned above, can be written, uniquely, as 
y = y + Ax’ for some y’ € N(¢,, ,) and some scalar J. Thus x = y’ + 
(Ax’ +z) where y € N(g,,,) and Ax’ +z is in the linear span of 
{x’, X,}. Since x’ ¢ X,,, this linear span has dimension k + 1, and hence 
N(Oy41) = N(@xy41) O N, has codimension & + 1 in X. 

We now return to problem 6b. Let N, = (\?_, N(@,) and note that 
N, has codimension p in X. Since p is finite both X/N, and (X/N,)* 
have dimension p. But the set {@,, 62,..., @,} is contained in (X/N,)*, 
is linearly independent, and contains p elements. Thus this set spans 
(X/N,)*. Since @o € (X/N,)* it is a linear combination of ¢4, ..., 6). 
and so {@o, $;, ..., Pp} is a linearly dependent set. 


EXERCISES 2.4 


Problem 3. Let B be a Banach space and let G be a closed, linear 
subspace of B that has a complement in B. In order to show that any 
two complements of G are topologically isomorphic it suffices to prove 
that any complement, say H, of G is topologically isomorphic to the 
Banach space B/G. There is a continuous projection operator P from B 
onto H with null space G. Define a map x from B/G onto H as follows: 
If x € B/G let x(x) = P(x) where x is any element of x. Clearly z is 
linear. Also, since P maps B onto H, z is onto. If x(x) = x(j), then 
P(x) = P(y’) for all x € x and all y € y. It follows that x — y € G, which 
says X = y. So 2 is One-to-one. Once we have shown that z is contin- 
uous then, by the open-mapping theorem, we will have shown that z is 
a topological isomorphism. Clearly, ||7(x)|| < ||P] ||x|] for every x € x. 
Thus |{x(x)\| < |/P|| inf{|x|||x € x}. But, by definition, inf{{\x|| |x € x} 
= |x|]. Hence |x(x)] < | Pl | 


EXERCISES 2.5 


Problem 2. We have two closed, linear subspaces G and H ofa 
Banach space (B, ||: ||). Assume that G ~ H = {0} and that there is a 
scalar a such that |\g|| < a||g + h|j for all g in G and all h € H. We want 
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to prove that G + H is closed. Let {g, + h,} be a sequence of points of 
G + H that converges to z € B. Then given ¢ > 0 we have 


ldn — Gm |) < |I(Gn ~ Gm) + (Ay — Fim) 
= al|(Gn + hn) ~ (Gm + Am)l| < xe 


for m, n sufficiently large. It follows that {g,} is a Cauchy sequence of 
points of G, and hence that lim g,, which we shall call go, is a point of 
G. Since lim{g, + h,} = z and lim g, = go we see that lim h, must exist. 
Call this hg and note that hy) € H. But then go + hg = 2, which says 
G + Hts closed. 


EXERCISES 3.4 


Problem la. Let (B,, ||-||,) and (B,, ||- ||.) be two completions of 
(E, ||: ||). We may regard E as a dense linear subspace of (B,, ||- ||) and 
also of (B., ||) and |||, = |-| = [2 on E. Ifx € By, x ¢ , then 
there is a sequence of points of E (call it {x,}) that converges to x for 
|-||,. Define a map @ from B, onto B, as follows: For x e€ E let 
$(x) = x, for x € B, but not in E let @(x) = lim @(x,) for ||: ||,. 

Since {x,} is a Cauchy sequence in (E, ||-||) and $(x,,) = x, for all n, 
it is clear that lim $(x,) exists in (Bp, ||- ||). Furthermore, if {x,}, {z,} 
are two sequences of points of E and if lim x, = lim z, in (B,, |: ||,), 
then {x, — z,} converges to zero for (E, ||: ||). Thus {O(x,) — $(z,)} also 
converges to zero for (E, |||!) and this says that lim $(x,) = lim $(z,) 
in (B, ||-|]2). Thus @ is well defined. 

It is easy to see that @ is linear. Suppose y € B,, y ¢ E, is given. 
There is a sequence {y,' of points of E that converges to y for ||-||,. But 
then {y,} is Cauchy for ||: ||, and hence {y,} converges to some element 
x € B, for ||-||,. Clearly, p(x) = y and so the map @ is onto. Suppose 
$(x) = $(z) for two elements x, z in B,. Choose sequences {x,}, {z,} of 
points of E such that lim x, = x, lim z, = z for ||-||;. Then {6(x,) — 
$(z,)} converges to zero for ||- ||, . It follows that {x, — z,} converges to 
zero for ||-||,. Hence x = z and @ is one-to-one. 

The only thing left to prove is that ||¢(x)||, = ||x||, for all x € B,. 
Given x € B, choose {x,} cE such that lim x, =x. Then since 
D(x, )l2 = Ix, | = |]x, |, for all n, and since ||6(x)|. = lim|(x,)||2 
while ||x||, = lim ||x, ||;, we see that @ is an equivalence. 
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Problem 1b. Let (B, ||-||) be the completion of (E, ||: ||). We shall 
show that the Banach spaces B’ and E’ are equivalent. Let f € E’. For 
any two elements x, y of E we have | f(x) —f(y)| < ||| lx — yl]. It 
follows that f is uniformly continuous on (E, ||: ||). Now E is dense in 
(B, ||: ||), and hence f has a unique, uniformly continuous extension to 
all of B. Call this extension f. We recall that f(x) = f(x) for all x € E, 
and that if x € Bbut is not in Ethenf(x) = lim f(x,), where {x,} is any 
sequence of points of E that converges to x. It is clear from this that f 
must be linear whenever fis linear, and so iff € E’,f € B’. Define u from 
E' into B’ as follows: For each f¢ E’ let u(f) =f It is trivial to show 
that u is linear, one-to-one, and onto. Since || f || = sup{| f(x)| |x € E, 
||x|| < lyand || f || = sup{| f(y)| |y © B, ||y|| < 1}, in order to show that 
lu(f)|| = ||f || for all fe E' it suffices to show that the unit ball of E is 
dense in the unit ball of B. 

Let # be the unit ball of B, A(£) the unit ball of E. We must show 
that each y € # is the limit of a sequence of points of 4(E). Let ye # 
and let {x,} be any sequence of points of E that converges to y. There 
are two cases: (i) |||! < 1; (ii) |ly|| = 1. In case (i) we can choose N so 
that x, — yl <1— fy for all n>N. Then [x,l <x, — yl + 
\ly\| < 1 for all n> N, and so {x,|n > N} is a sequence in A(E) that 
converges to y. 

In case (ii) let S = {n||[x, | > 1} and let T = {n||\x, |] < 1. If T is 
an infinite set, then {x,,|m € T} is a sequence of points of 4(E) that 
converges to y; sO We may assume that T is a finite set, and hence S is 
an infinite set. Let y,, = Xm ||Xm ||” | for every m € S. Then {y,,} < B(E), 
lim y,, = lim x,, lim||x,, |~’ = lim x,,° 1 = y. 


EXERCISES 4.1 


Problem la. Let Ue ¥. We may assume that there is a finite 
number of seminorms p,, p2,..., p, in the given family, and a finite 
number of positive numbers ¢,, 6&2,...,  €, such that 
U= {xe X|p(x)<e, for 1<i<n}. Define Ve ¥ as follows: 
V={x eX |p(x)<e,/2 for 1<i<n}. We want to show that 
V+VcU. Let x+yeV+V and note that p(x + y) < p(x) + 
ply) <¢; for 1 <i<n. 
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Problem 1b, Let U beas in problem la. Let N = {a€ K| la] <1} 
and let V= U. ThenaV cU forallaeN. 

Problem Ic. Clearly the sequence {x,| is t-convergent to Xo iff 
{X, — Xo} is t-convergent to zero. We shall show that {x,; is f- 
convergent to zero iff lim p,(x,) = 0 for every p,,. First assume that {x,} 
is t-convergent to zero. For each k let VW, = {x |p,(x) < 1/k}. Then we 
must have x, € ¥V, for all n sufficiently large. Thus p,(x,,) < 1/k for all n. 
Now since k is arbitrary, lim p,(x,) = 0. 

Now suppose that lim p,(x,)=0 for every p,. Given any 1- 
neighborhood U of zero we may assume that U = {x|p,x) <«; for 
1 <j <k}. We can find n, such that p,(x,) <¢; for n >n,. Similarly, 
we can find n, such that p3(x,,) < &2 for n > nz, etc. Choose no greater 
than any of the numbers n,, n;,..., n,. Then p,(x,) <«; for all n > no 
and for j = 1, 2,...,k; te, x, € U for alln > no. 

Problem 3a. Suppose that S is a total subset of E and that lin S 
(the linear span of S) is not dense in E, Then the closure of lin S, call it 
cl(lin S), is a proper, closed, linear subspace of E. By the Hahn-Banach 
theorem there is an element f € E’ that is not zero on all of E but is zero 
on all of cl(lin S). But then f vanishes on S but not on all of E, contra- 
dicting the fact that S is total. 

Now suppose that lin S is dense in E. If f'€ E’ vanishes on S, then it 
must vanish on lin S; this is a consequence of the linearity of f: But 
then f vanishes on a dense subset of E. Since a continuous, linear 
functional on E is obviously uniformly continuous on E£, this is 
impossible. 

Problem 3b. If E is separable, then any countable, dense subset of 
E is a countable, total subset of E. Suppose that E contains a count- 
able, total subset S. By problem 3a the space lin S is dense in E. Thus 
given ¢>0 and xeE there is an element ye lin S such that 
lx ~ yl] <2. Nowy =)". , a;s;wheres,,...,s,arein Sand a, ...,a, 
are scalars-let us say real scalars. Let M = max{||s,|||j = 1, 2,..., 1} 
and for each j let g, be a rational number such that |a;— q;| <¢/nM. 
Then 


Ix — > asi] 
< |x — ¥ ajs5l] + IX 595 - Y aisill 
<ée+y |a;—;| ||s;|] <2. 


So the set of all linear combinations, with rational coefficients, of 
elements of S is dense in E. Since this set is countable, E is separable. 


Problem 4a. Let u be a linear map from (E, ||: ||) into (F, {{{- |||). 
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Define u* from F’ into E’ as follows: For each ¢ € F’, u*(@) is the 
element of E’ defined by u*(p)x = ¢[u(x)] for all x € E. We call u* the 
adjoint of u. 

For @,, @2 in F’ and any scalars a, B we have 


u*(aB, + Bo2)x = (ap, + Bp2)[u(x)] = ap ,[u(x)] + Bb2[u(x)] 
= a[u*(,)(x)} + Blu*(b2)(x)] 
for all x € E. Hence u*(ap, + Bp2) = au*(,) + Bu*(2), and we have 
shown that u* is linear. 
Suppose that u is continuous and give F’, E’ their norm topologies. 


Since u is continuous there is a constant M such that |//u(x)|| < 
M||x|| for all x € E, Now sup{|\u*(o)|||@ € F’, |@|| < 1!, and 


||w*(p)| = sup{ |u*(o)x| |x € E, |x|] < 1} 
sup{|[u(x)]] |x € E, |x| < lj < ||| lull. 


Thus sup{||u*($)|| |@ € F’, |O|| < 1} < lull < M. It follows that u* is 
continuous, and also that ||u*|| < |lul|. 

We will now show that we actually have |u*|| = |lul|. For any 
@ € F and any x € E we have |¢[u(x)}| < ||| | ||u(x)|| |. If x is fixed, 
then we can find @ € F’ such that ||| = | and ¢[u(x)] = | |lu(x)]] | (by 
the Hahn-Banach theorem). It follows that sup{| @[u(x)]||||@|| < 
1} = | ||u(x)|| |; here x is any element of E. Using the definition of u* we 
may write sup{|u*(p)x | ||] <1} = |u(x)) |. But 


sup{ |u*(p)x| |} || < 1} <supfiu*| id] |x|] loll < Ys lw |x]. 


So for every x € E we have | ||u(x)||| < ||u*| [x]. It follows that 
lull < Jur 

Finally, we want to show that u* is continuous when E’ and F’ have 
their weak* topologies. Let U be a weak* neighborhood of zero in E’. 
We may assume that there is a finite set x,, x2, ..., x, Of points of E 
and positive numbers ¢;,€2, ..., €, such that U = {fe E’'|| f(x,)| <e; 
for | <i <n}. Then 


ii 


V = (ge F'\u*(g) € U) = {g € F'| |u*(g)x;| <¢; for 1<i<n} 
= {ge F'\ |g[u(x,)]| <6 for 1<i<n} 
is a weak* neighborhood of zero in F’. 


Problem 4b. We will now assume that u is an equivalence and we 
shall prove that u* is an equivalence. By problem 4a we know that u* is 
linear, and that it is continuous when E’ and F’ have their norm 
topologies. If u*(@) = 0 for some @ € F’, then u*()x = 0 for all x € E. 
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Thus ¢[u(x)] = 0 for all x € E. But u is onto and so ¢ must be the zero 
functional; i.e., u* is one-to-one. 

Let us now show that u* is onto. Let fe E’, f # 0, and let N(f) be 
the null space of f, We know that N(f) has codimension one in E and, 
since u is an equivalence, clearly u[N(f)] = {u(x)|x e N(f)! is a 
closed, linear subspace of codimension one in F. It follows that there is 
a g€F’ such that N(g)=u[N(f)]. Consider u*(g) € E’. Clearly, 
u*(g)x = 0 means g[u(x)] = 0, and so N[u*(g)] contains N(f). Hence 
u*(y) = Af for some nonzero scalar A. But then u*(A~ 'g) =f and we 
have shown that u* is onto. 

Finally, we shall show that u* is norm preserving. If g € F’, then 
u*(y)x| = |glu(x)]| < loll lux)! = lal x] for all xe E. So 
u*(g)\| < [ly||- Also, gl = sup{|g()| |y € 
lly] < 1) = sup{| glu(x)] | I cE, 
x|| < 1} because u is an equivalence. Hence |\g|| < |g » ul] = |lu*(g)]. 
Problem 5. Let {f,' be any bounded sequence in E’ and let {x,' be 
any countable, dense subset of E. We have | f,(x1)| < {fill llxi || < 
om ||, for all n. Thus there is a 
subsequence { f}! of { f,! such that { f}(x,)} converges. Now {f}(x2)} is 
a bounded sequence of complex numbers, and so there is a sub- 
sequence { f?' of {ff} such that { f?(x2)} is convergent. Clearly {f(x ,)} 
is also convergent. 

After {fn}, {fn}... {fn} have been chosen, observe that 
{ft (Xi+ i} is a bounded sequence of complex numbers, and hence that 
there is a subsequence { f** '} of { f*} such that {f** '(x,)} is convergent 
forj=1,2,...,k+ 1. 

Now let g, =f 1, 92 = 3,93 =f 3, +--+. Gx =S i, »--. It is clear that, 
after the Ath term, {g,} is a subsequence of { ff}, and that this is true for 
k = 1,2,.... Hence {g,(x,)} converges for each k = 1, 2, .... Now (g,} is 
contained in the unit ball of E’. This ball is o(£’, E)-compact and so 
{gn} must have a o(E’, E)-adherent point go € E’. Since {g,(x,)} con- 
verges its limit must be go(x,) for k = 1, 2,.... 

Suppose that x € E and « > 0 are given. First choose x, such that 
|x — x,|| </3. Then 


lgo(x) — galx)| < |golx) — golx,)| 
+ |golx;) — gnlx;)| + |Gn(xj) — Gul) 
< doll |x — xj] + Lgols) — gnlx,)| 
+ {lou{| [xj — x1. 
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The first and last terms are <¢/3. The middle term can be made <é/3 
by taking n sufficiently large. 


EXERCISES 4.2 


Problem 1b. Let S be a subset of X and let F be the family of all 
convex subsets of X that contain S; ¥ is not empty because X € .#. By 
definition the convex hull of S (we shall denote it by conv (S)) is 
(\{C|C € F}. Define G to be the set {J%_, a;x,|n is a positive 
integer, x,,..., x, are in S, a,,..., &, are nonnegative scalars with 
yr, a; = 1}. Clearly S cG. 

We shall show that G is convex. Let x, y € G and let y be a scalar 
between zero and one. We must show that yx + (1 —y)y is in G. 
Clearly, x = )%_, ajx; andy =)", f,y;. Since all the x,'s and all the 
ys are in S all we have to do, in order to prove that yx + (1 — y)y isin 
G, is to show that )"_, ya; + )7L, (1 — y)B; = 1. But this is easy be- 
cause the first term is just y and the second is 1 — y. 

It follows that conv(S) < G. To prove the reverse inclusion it 
es to show that for any C € .¥,G <C. Let )4_, a,x, € Gand let 
C € F. Clearly x,, ..., x, are in C because they are in S. ‘So all we have 
to do is show that, for any finite subset x,, ..., x, ofa convex set C and 
any nonnegative scalars a,,..., «, whose sum is one, we have 
Vye1 ax; € C. We shall prove this by induction on n. 

If n=1 the result is trivial, and when n= 2 it is true by the 
definition of convexity. Assume that it is true when n=k — 1 and 
consider 


k k-1 k-1 
(*) 2 = Yay, i+ OX, = 2%; + (1 _ ¥ a) 
jz j= j=l 


because S*_, a, = 1. Let B=} 42] a, and clearly we may assume 
B #0. Since S42} (a;/B) = 1 we can write ine right-hand side of («) as 
follows: Y=} 2,542 ={ a;/B)x;+ (1 — Y4=} a,)x,. By our induction 
hypothesis the term yet (a; /B)x; is in C; denote this sum by y. So we 
now can write the right-hand side of («) as: By + (1 ~ B)x,, and this is 
clearly in C. 
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EXERCISES 4.3 


Problem la. Let X[t] be a locally convex space, let xp € X, and 
define g(x) to be x + Xp for all x € X. It is clear that g is a one-to-one 
mapping from X onto itself. Since (x, y) > x + y is a continuous func- 
tion from X x X onto X, g is continuous. To prove that g is a homeo- 
morphism we need only show that the continuous map h, defined by 
h(x) =x—Xo for all x eX, is the inverse of g. But h[g(x)] = 
h[x + Xo] = (x + Xo) — Xo = x and 


glh(x)] = glx — xo] = (x — Xo) + Xo = x. 


Problem 1b. Assume that f is continuous at zero and let x be any 
point of X, V any neighborhood of f(x). Then V — f(x) is a neighbor- 
hood of zero and so there is a neighborhood of U of zero such that 
f(U) <V—f(x) Now U+x is a neighborhood of x and 
f(U +x) <f(U) +f (x) OV f(x) + f(x) = V. 

We will now show that f is continuous at zero iff it is bounded on 
some t-neighborhood U of zero. If we assume that f is continuous at 
zero then {x € X| | f(x)| < 1} is a t-neighborhood of zero on which fis 
bounded. Conversely, let us assume that | f(U)| <M for some t- 
neighborhood U of zero. Then given ¢ > 0 we have | f(x)| < for all x 
in the t-neighborhood (¢/M)U of zero. Hence f is continuous at zero. 


Problem 1c. We need only show that (iii) implies (i). So we assume 
that f # 0 is a linear functional on X, that the null space of f, N(f), is 
not dense in X[r], and that f is not continuous at zero. Our assump- 
tions imply the existence of a nonempty open set G such that 
Go N(f)= @. If x € G we can find a balanced t-neighborhood U of 
zero such that x + U cG. Now by problem 1b above, f(U) is not 
bounded. In fact, f(U) is the entire field K. So there is a point x’ in U 
such that f(x’) = —f(x). Clearly, x + x’ is in N(f). But x + x’ is also in 
x + U cG, and this is impossible because G 4 N(f) = @. 


Problem 3a. We have X[r], where t = t({p,!) and {p,|y eT} isa 
family of seminorms on X. We want to show that B c X is t-bounded 
iff sup{p,(x)|x € B} is finite for every ». Suppose that B is t-bounded. 
Then, for any p,, the set U(p,)={xeX|p,x)<1} is a t- 
neighborhood of zero. Hence there is a scalar A such that B < AU(p,). 
But this says p,(x) <A for all x € B. 
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Now suppose that B satisfies our condition and let U be a t- 
neighborhood of zero. We may assume that there is a finite subfamily 
Pi, Po,---, Pn in {p,} and positive numbers ¢,,..., 6, such that 
U = {x € X |p(x) <e, for 1 <j <n}. Now sup p,(B) < M, for j = 1, 
2,..., n by assumption. Hence p,{(e; Mj ')B] < ¢, for j = 1,2, ...,n. Let 
é = min{e,!, M = max{M,}. Then (Me~')U contains B. 

Problem 3c. Let @ be a continuous, linear map from X[t] into 
Y[s]. Assume that B is a t-bounded subset of X. We shall show that the 
set @(B) is an s-bounded subset of Y. Let U be any s-neighborhood of 
zero in Y. Since @ is linear (¢(0) = 0) and continuous, @~ '(U) is a 
neighborhood of zero in X[t]. Now B is t-bounded and so there is a 
scalar A such that B < Ap~ '(U). But then ¢(B) < AU and we are done. 


APPENDIX B 


Reflexive Banach Spaces 


We have characterized the reflexive spaces as those Banach spaces 
in which the unit ball is compact for the weak topology (Section 4.4, 
Theorem 2). Equivalently, they are the Banach spaces in which the unit 
ball is countably compact for the weak topology (Section 5.2, Theorem 
3 and Remark 2). There are many, many other characterizations of this 
class of spaces (see, for example, [30, pp. 69-72]). Of all of these the 
most striking is that due to James [33]. He proved that a Banach space 
Bis reflexive iff every element of B’ attains its supremum over the unit 
ball of B. A continuous, linear functional that attains its supremum 
over the unit ball of a Banach space is said to attain its norm. For any 
Banach space B the set of all elements of B that attain their norms is 
dense in B’ for the norm topology [29]. 

Many writers have treated more general classes of Banach spaces 
that contain, and are in some way similar to, the reflexive spaces. For 
example, it is clear that every reflexive Banach space is a dual space 
(Section 5.1). A thorough, and very beautiful, discussion of dual spaces 
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can be found in the classic paper of Dixmier [32]. Equivalent forms of 
some of Dixmier’s results were obtained (apparently independently) by 
Ruston [34]. Ruston’s approach is illuminating and his proofs are 
different from those of Dixmier. We shall mention only one result. A 
Banach space B is a dual space iff there is a closed, linear subspace Q in 
B' that has the two following properties: (a) If 4’ denotes the unit ball 
of B’ then Q - B' is o(B’,, B)-dense in 4’. (b) The unit ball of B is 
compact for the topology o(B, Q) [32, Théoréme 17]. 

A closed, linear subspace of B’ that has property (a) is said to be a 
subspace of characteristic one in B’. Such a subspace need not have 
property (b) (see [32, 31, Theorem 4]). We proved a theorem about the 
completion of a locally convex space that enabled us to connect the 
work of James with that of Dixmier to obtain the following result: A 
separable Banach space B is a dual space iff B’ contains a subspace of 
characteristic one each element of which attains its norm [31]. The 
analogous statement for nonseparable Banach spaces is false. 

For more results about dual spaces as well as other generalizations 
of reflexivity we refer the reader to the literature. 
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